Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Server info oop #192

Merged
merged 30 commits into from
Jan 21, 2018
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
30 commits
Select commit Hold shift + click to select a range
443918a
Release(v2.7.5)
strizhechenko Jan 14, 2018
e4e6c31
Refactoring(server-info): Assessor -> Rater.
strizhechenko Jan 15, 2018
d918693
Refactoring(server-info): added new class structure (prototype).
strizhechenko Jan 15, 2018
d0ad0ce
Refactoring(server-info): removed argparse usage from Rater
strizhechenko Jan 15, 2018
26604c8
Refactoring(server-info): moved CPU rate from Rater to CPU
strizhechenko Jan 15, 2018
32c1bb2
Fixed(server-info): import extract directly from rater_math in CPU
strizhechenko Jan 15, 2018
91b1e0d
Restored(server-info): server-info-rate runs where missed in tests.
strizhechenko Jan 15, 2018
c78d793
Refactoring(server-info): base __init__/__rate for every subsystem
strizhechenko Jan 15, 2018
2f44e2d
Fixed(server-info): __rate in base class didn't worked because __, re…
strizhechenko Jan 15, 2018
5194e1e
Refactoring(server-info): moved last subsystem (system) to the separa…
strizhechenko Jan 15, 2018
95ee548
Refactoring(server-info): all subsystem-specific parsers moved to app…
strizhechenko Jan 15, 2018
ebf30f7
Refactoring(server-info): reader moved subsystem-specific data to app…
strizhechenko Jan 16, 2018
3c7fff2
Refactoring(server-info): yaml module -> yaml_tools to avoid conflicts
strizhechenko Jan 21, 2018
db82696
Refactoring(server-info): simplified any2int logic.
strizhechenko Jan 21, 2018
0bed6ee
Refactoring(server-info): simplified any2int logic.
strizhechenko Jan 21, 2018
c924fa8
Refactoring(server-info): parsing dmidecode output simplified
strizhechenko Jan 21, 2018
551849a
Refactoring(server-info): no six dependency > slightly higher memory …
strizhechenko Jan 21, 2018
9aa50a8
Refactoring(server-info): no six dependency > slightly higher memory …
strizhechenko Jan 21, 2018
dd4eb57
Refactoring(server-info): simplified invert_dict_nesting logic.
strizhechenko Jan 21, 2018
02d5e23
Refactoring(server-info): moved main logic from cli to Server class.
strizhechenko Jan 21, 2018
2ef2ca0
Refactoring(server-info): optimized imports.
strizhechenko Jan 21, 2018
e8b7889
Refactoring(server-info): naming in invert_dict_nesting
strizhechenko Jan 21, 2018
b24403d
Refactoring(server-info): removed Rater class, Server rates itself.
strizhechenko Jan 21, 2018
c82348c
Refactoring(server-info): removed Reader class, Server read its data …
strizhechenko Jan 21, 2018
e0c21a2
Fixed(server-info): syntax error
strizhechenko Jan 21, 2018
3833597
Refactoring(server-info): removed separate cli class, its Server's args
strizhechenko Jan 21, 2018
74e5bb3
Refactoring(server-info): specified exception type for str2int
strizhechenko Jan 21, 2018
202e5b0
Refactoring(server-info): removed -f / -ff / -fff args.
strizhechenko Jan 21, 2018
7310eda
Fixed(server-info): --rate didn't work without folding in py3
strizhechenko Jan 21, 2018
6bb5b0a
Refactoring(server-info): removed Collector class, Server collects it…
strizhechenko Jan 21, 2018
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Refactoring(server-info): Assessor -> Rater.
  • Loading branch information
strizhechenko committed Jan 15, 2018
commit e4e6c31458969e585064a0b22ad2be206e26957c
6 changes: 3 additions & 3 deletions netutils_linux_hardware/__init__.py
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
from netutils_linux_hardware import netdev
from netutils_linux_hardware import parsers
from netutils_linux_hardware import parser
from netutils_linux_hardware import interrupts
from netutils_linux_hardware.reader import Reader
from netutils_linux_hardware.assessor import Assessor
from netutils_linux_hardware.rater import Rater

__all__ = ['parsers', 'netdev', 'interrupts', 'Reader', 'Assessor']
__all__ = ['parser', 'netdev', 'interrupts', 'Reader', 'Rater']
4 changes: 2 additions & 2 deletions netutils_linux_hardware/cli.py
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@

from six import print_

from netutils_linux_hardware.assessor import Assessor, FOLDING_NO, FOLDING_DEVICE, FOLDING_SUBSYSTEM, FOLDING_SERVER
from netutils_linux_hardware.rater import Rater, FOLDING_NO, FOLDING_DEVICE, FOLDING_SUBSYSTEM, FOLDING_SERVER
from netutils_linux_hardware.collect import ServerInfoCollect
from netutils_linux_hardware.reader import Reader

Expand Down Expand Up @@ -71,4 +71,4 @@ def main(self):
ServerInfoCollect(directory, tarball, self.args.collect)
if self.args.rate or self.args.show:
reader = Reader(directory, self.args)
print_(Assessor(reader.info, self.args) if self.args.rate else reader)
print_(Rater(reader.info, self.args) if self.args.rate else reader)
2 changes: 1 addition & 1 deletion netutils_linux_hardware/grade.py
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
# coding: utf-8
from netutils_linux_hardware.assessor_math import any2int, round_
from netutils_linux_hardware.rater_math import any2int, round_


class Grade(object):
Expand Down
2 changes: 1 addition & 1 deletion netutils_linux_hardware/interrupts.py
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
# pylint: disable=C0111, C0103

from six import print_
from netutils_linux_hardware.parsers import Parser
from netutils_linux_hardware.parser import Parser


class NICQueues(object):
Expand Down
2 changes: 1 addition & 1 deletion netutils_linux_hardware/netdev.py
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
import os
from six import iteritems
from netutils_linux_hardware.interrupts import IRQQueueCounter
from netutils_linux_hardware.parsers import EthtoolBuffers, ReductorMirror, BridgeOutput, YAMLLike, EthtoolFiles
from netutils_linux_hardware.parser import EthtoolBuffers, ReductorMirror, BridgeOutput, YAMLLike, EthtoolFiles


class ReaderNet(object):
Expand Down
File renamed without changes.
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@

import yaml

from netutils_linux_hardware.assessor_math import extract
from netutils_linux_hardware.rater_math import extract
from netutils_linux_hardware.grade import Grade

FOLDING_NO = 0
Expand All @@ -12,7 +12,7 @@
FOLDING_SERVER = 3


class Assessor(object):
class Rater(object):
""" Calculates rates for important system components """
info = None
avg = None
Expand All @@ -22,7 +22,7 @@ def __init__(self, data, args):
self.data = data
self.args = args
if self.data:
self.assess()
self.rate()

def fold(self, data, level):
""" Схлапывает значения в дикте до среднего арифметического """
Expand All @@ -36,24 +36,24 @@ def fold(self, data, level):
def __str__(self):
return yaml.dump(self.info, default_flow_style=False).strip()

def assess(self):
def rate(self):
data = dict()
for key in self.keys:
if not getattr(self.args, key):
continue
elif key == 'net':
data[key] = self.__assess(self.assess_netdev, 'net')
data[key] = self.__rate(self.rate_netdev, 'net')
elif key == 'cpu':
data[key] = self.assess_cpu()
data[key] = self.rate_cpu()
elif key == 'memory':
data[key] = self.assess_memory()
data[key] = self.rate_memory()
elif key == 'disk':
data[key] = self.__assess(self.assess_disk, 'disk')
data[key] = self.__rate(self.rate_disk, 'disk')
elif key == 'system':
data[key] = self.assess_system()
data[key] = self.rate_system()
self.info = self.fold(data, FOLDING_SERVER)

def assess_cpu(self):
def rate_cpu(self):
cpuinfo = extract(self.data, ['cpu', 'info'])
if cpuinfo:
return self.fold({
Expand All @@ -67,7 +67,7 @@ def assess_cpu(self):
'Vendor ID': Grade.str(cpuinfo.get('Vendor ID'), good=['GenuineIntel']),
}, FOLDING_SUBSYSTEM)

def assess_memory_device(self, device):
def rate_memory_device(self, device):
return self.fold({
'size': Grade.int(device.get('size', 0), 512, 8196),
'type': Grade.known_values(device.get('type', 'RAM'), {
Expand All @@ -79,36 +79,36 @@ def assess_memory_device(self, device):
'speed': Grade.int(device.get('speed', 0), 200, 4000),
}, FOLDING_DEVICE)

def assess_memory_devices(self, devices):
def rate_memory_devices(self, devices):
if not devices:
return 1
return self.fold(dict((handle, self.assess_memory_device(device))
return self.fold(dict((handle, self.rate_memory_device(device))
for handle, device in devices.items()),
FOLDING_SUBSYSTEM)

def assess_memory_size(self, size):
def rate_memory_size(self, size):
return self.fold({
'MemTotal': Grade.int(size.get('MemTotal'), 2 * (1024 ** 2), 16 * (1024 ** 2)),
'SwapTotal': Grade.int(size.get('SwapTotal'), 512 * 1024, 4 * (1024 ** 2)),
}, FOLDING_DEVICE) if size else 1

def assess_memory(self):
def rate_memory(self):
meminfo = self.data.get('memory')
if meminfo:
return self.fold({
'devices': self.assess_memory_devices(meminfo.get('devices')),
'size': self.assess_memory_size(meminfo.get('size')),
'devices': self.rate_memory_devices(meminfo.get('devices')),
'size': self.rate_memory_size(meminfo.get('size')),
}, FOLDING_SUBSYSTEM)

def assess_system(self):
def rate_system(self):
cpuinfo = extract(self.data, ['cpu', 'info'])
if cpuinfo:
return self.fold({
'Hypervisor vendor': Grade.fact(cpuinfo.get('Hypervisor vendor'), False),
'Virtualization type': Grade.fact(cpuinfo.get('Hypervisor vendor'), False),
}, FOLDING_SUBSYSTEM)

def assess_netdev(self, netdev):
def rate_netdev(self, netdev):
netdevinfo = extract(self.data, ['net', netdev])
queues = sum(
len(extract(netdevinfo, ['queues', x])) for x in ('rx', 'rxtx'))
Expand All @@ -132,20 +132,14 @@ def assess_netdev(self, netdev):
}, FOLDING_DEVICE)
}, FOLDING_DEVICE)

def assess_disk(self, disk):
def rate_disk(self, disk):
diskinfo = extract(self.data, ['disk', disk])
return self.fold({
'type': Grade.str(diskinfo.get('type'), ['SDD'], ['HDD']),
# 50Gb - good, 1Tb - good enough
'size': Grade.int(diskinfo.get('size'), 50 * (1000 ** 3), 1000 ** 4),
}, FOLDING_DEVICE)

def __assess(self, func, key):
def __rate(self, func, key):
items = self.data.get(key)
return self.fold(dict((item, func(item)) for item in items), FOLDING_SUBSYSTEM) if items else 1

def parse_args(self):
parser = argparse.ArgumentParser()
parser.add_argument('-f', '--folding', action='count', help='-f - device, -ff - subsystem, -fff - server',
default=FOLDING_NO)
return parser.parse_args()
2 changes: 1 addition & 1 deletion netutils_linux_hardware/reader.py
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
import yaml

from netutils_linux_hardware.netdev import ReaderNet
from netutils_linux_hardware.parsers import YAMLLike, CPULayout, DiskInfo, MemInfo, MemInfoDMI
from netutils_linux_hardware.parser import YAMLLike, CPULayout, DiskInfo, MemInfo, MemInfoDMI


class Reader(object):
Expand Down
2 changes: 1 addition & 1 deletion netutils_linux_hardware/test_grade.py
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
from unittest import TestCase, main
from six import iteritems
from netutils_linux_hardware.grade import Grade
from netutils_linux_hardware.assessor_math import any2int
from netutils_linux_hardware.rater_math import any2int


class GradeTest(TestCase):
Expand Down
2 changes: 1 addition & 1 deletion netutils_linux_hardware/test_parsers.py
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@

from unittest import TestCase

from netutils_linux_hardware.parsers import DiskInfo
from netutils_linux_hardware.parser import DiskInfo


class DiskInfoTests(TestCase):
Expand Down
2 changes: 1 addition & 1 deletion netutils_linux_monitoring/topology.py
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@

from six import print_

from netutils_linux_hardware.assessor_math import any2int
from netutils_linux_hardware.rater_math import any2int


class Topology(object):
Expand Down
2 changes: 1 addition & 1 deletion netutils_linux_tuning/rss_ladder.py
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@
from six import print_
from six.moves import xrange

from netutils_linux_hardware.assessor_math import any2int
from netutils_linux_hardware.rater_math import any2int
from netutils_linux_monitoring.colors import wrap, YELLOW, cpu_color, COLORS_NODE
from netutils_linux_monitoring.topology import Topology
from netutils_linux_tuning.base_tune import CPUBasedTune
Expand Down