Troubleshooting¶

The poller logs are located in :

/var/log/numeter/numeter-poller.log

Debian packages¶

Build your own Debian packages with git-buildpackage or pbuilder for exemple or use numeter repo : http://repo.numeter.com (coming soon)

apt-get install numeter-poller

deb http://cloud.pkgs.enovance.com/wheezy-grizzly grizzly main
apt-key adv --recv-keys --keyserver keyserver.ubuntu.com E52660B15D964F0B

Manual¶

Depends:

• python-kombu
• python-oslo.messaging
• numeter-common (rpc module)
• python-daemon
• (rabbitmq-server)
• (munin-node)

apt-get install python-daemon

apt-get install python-kombu

apt-get install python-oslo.messaging

apt-get install python-dev python-setuptools
easy_install pip

pip install git+git://github.com/openstack/oslo.messaging.git@7914181398630cbcbc25543d72871ccf812df517

git clone https://github.com/enovance/numeter
cd numeter

cd common && python setup.py install

cd poller && python setup.py install

Quick config¶

vim /etc/numeter/numeter_poller.cfg
enable = false -> true

host_id = 123456789

numeter-poller

/etc/init.d/numeter-poller start

Local database format¶

+--------+         +---------------+
|  HSET  |         | INFOS@HostID1 | ----->  if   : {JSON:Value:ID:...}
+--------+         +---------------+   |-->  df   : {JSON:Value:ID:...}
                   +---------------+
                   | INFOS@HostID2 | ----->  if   : {JSON:Value:ID:...}
                   +---------------+   |-->  df   : {JSON:Value:ID:...}

+--------+         +-------------+
|  HSET  |         |   HOSTS     | ----->  Host1   : { MyInfos }
+--------+         +-------------+   |-->  Host2   : { MyInfos }

+--------+         +---------------+
|  HSET  |         |   HOST_ID     | ----->  HostID1   : md5sum(HostID1)
+--------+         +---------------+   |-->  HostID2   : md5sum(HostID2)

+--------+         +-------------+
|  HSET  |         |  WSP_PATH   | ----->  HostID1   : /opt/wsp/1
+--------+         +-------------+   |-->  HostID2   : /opt/wsp/2

+--------+         +------------------+
|  HSET  |         |  DELETED_HOSTS   | ----->  HostID3   : WSP_PATH
+--------+         +------------------+   |-->  HostID4   : WSP_PATH

+--------+         +--------------------+
|  HSET  |         |  DELETED_PLUGINS   | ----->  HostID1@plugin   : WSP_PATH/plugin
+--------+         +--------------------+   |-->  HostID2@plugin   : WSP_PATH/plugin

+-------+         +------------+
|  SET  |         |  OLD_WSP   | ----->  [WSP_PATH/plugin/wsp1, WSP_PATH/plugin/wsp2]
+-------+         +------------+

+-------+         +-------------------+
|  SET  |         |  LAST_WSP_CLEAN   | ----->  TimeStamp
+-------+         +-------------------+

Example of host-list file¶

Example of host list :

#Poller <hostID>
myhost-123456
myhost-789456

Troubleshooting¶

Get the host list in the storage

redis-cli -n 2 HGETALL HOSTS

Get plugin info for a host

redis-cli -n 2 hget "INFOS@<hostid>" df

Get the wsp path for a host

redis-cli -n 2 hget "WSP_PATH" <hostid>

Test the storage¶

Get hosts list from the rest api

curl http://127.0.0.1:8080/numeter-storage/hosts

Get plugin list from the rest api for a host

curl http://127.0.0.1:8080/numeter-storage/list?host=1349792119-d753e11726b68a08dbb5847f0d4b8f8e

The rest api code can be found in /usr/share/numeter/storage/numeter_uwsgi.py

Debian packages¶

Build your own Debian packages with git-buildpackage or pbuilder for exemple or use numeter repo : http://repo.numeter.com (coming soon)

apt-get install numeter-storage

deb http://cloud.pkgs.enovance.com/wheezy-grizzly grizzly main
apt-key adv --recv-keys --keyserver keyserver.ubuntu.com E52660B15D964F0B

After that you need to configure nginx :

cp /usr/share/doc/numeter-storage/numeter-storage-web.nginx.example /etc/nginx/sites-available/numeter-storage-web
ln -s /etc/nginx/sites-available/numeter-storage-web /etc/nginx/sites-enabled/
/etc/init.d/nginx restart

Same thing for uwsgi :

cp /usr/share/doc/numeter-storage/numeter-storage-uwsgi.ini.example /etc/uwsgi/apps-available/numeter-storage-uwsgi.ini
ln -s /etc/uwsgi/apps-available/numeter-storage-uwsgi.ini /etc/uwsgi/apps-enabled/
/etc/init.d/uwsgi restart

Manual¶

Depends:

• python-kombu
• python-oslo.messaging
• numeter-common (rpc module)
• python-redis >= 2.4.9
• redis >= 2:2.4.14
• python-whisper
• nginx
• uwsgi
• python-flask
• python-daemon
• (rabbitmq-server)

apt-get install nginx

apt-get install uwsgi uwsgi-plugin-python

apt-get install python-flask

apt-get install python-whisper

apt-get install python-redis

git clone https://github.com/andymccurdy/redis-py
cd redis-py
python setup.py install

apt-get install redis-server

apt-get install python-daemon

apt-get install python-kombu

apt-get install python-oslo.messaging

apt-get install python-dev python-setuptools
easy_install pip

pip install git+git://github.com/openstack/oslo.messaging.git@7914181398630cbcbc25543d72871ccf812df517

git clone https://github.com/enovance/numeter
cd numeter

cd common && python setup.py install

cd storage && python setup.py install

cp storage/storage-web/numeter-storage-web.nginx.example /etc/nginx/sites-available/numeter-storage-web
ln -s /etc/nginx/sites-available/numeter-storage-web /etc/nginx/sites-enabled/
/etc/init.d/nginx reload

cp storage/storage-web/numeter-storage-uwsgi.ini.example /etc/uwsgi/apps-available/numeter-storage-uwsgi.ini
ln -s /etc/uwsgi/apps-available/numeter-storage-uwsgi.ini /etc/uwsgi/apps-enabled/
/etc/init.d/uwsgi restart

Quick config¶

vim /etc/numeter/numeter_storage.cfg
enable = false -> true

vim /etc/numeter/host-list
#Poller <hostID>
myhost-123456

numeter-storage

/etc/init.d/numeter-storage start

Informations¶

This module is a Web server created for visualize data from Storage(s). In few lines Webapp purposes followings stuff:

• Authentication and authorization made by user and group management
• Multiple storga management
• REST API interface
• Storages’ API centralization

Unlike other web graph system, Numeter doesn’t only purpose a graph tree. It allow users to organize Data Sources in custom level of displaying.

WebApp is completly independant from other Numeter modules. The only connection point is Storage’s REST API.

External Links¶

Troubleshooting¶

Configuration¶

Webapp configuration is located in /etc/numeter/numeter_webapp.cfg`.

engine = django.db.backends.sqlite3

name = numeter
name = /var/db/numeter.db # with Sqlite

user = numeter

password = yourpass

host = db.my.lan

port = 3306

use_cache = True

location = unix:/var/run/memcached.sock

timeout = 3000

max_entries = 3000

timeout = 10

admins = [ ('admin', 'admin@locahost') ]

admins = ['numeter.my.lan','numeter.lan']

timezone = Europe/Paris

language_code = en-us

media_root
|- graphlib
   |- dygraph
      |- dygraph-combined.js
      |- dygraph-numeter.js

media_root = /var/www/numeter/media/

media_root = /etc/key.txt

use_logging = False

info_file = /tmp/info.log

error_file = /tmp/error.log

file_size = 2000000

debug = True

use_mock_storage = True

use_debug_toolbar = True

debug_internal_ips = ['192.168.0.2','192.168.0.3']

Debian packages¶

Build your own Debian packages with git-buildpackage or pbuilder for exemple or use numeter repo : http://repo.numeter.com (coming soon)

apt-get install numeter-webapp

Manual¶

Depends:

• python-django
• django-rest-framework
• django-filter

echo 'deb http://ftp.fr.debian.org/debian wheezy-backports main' >> /etc/apt/sources.list.d/debian-backports.list
apt-get update
apt-get install -t wheezy-backports python-django python-mimeparse

pip install djangorestframework==2.4.0
pip install django-filter

git clone https://github.com/enovance/numeter

cd numeter/web-app
python setup.py install

Configure¶

Webapp’s settings are by default in /etc/numeter/numeter_webapp.cfg. You have to define following stuff:

• A database backend
• A web frontend
• Optionnaly a cache backend

apt-get install mysql-server mysql-client
apt-get install python-mysqldb

CREATE DATABASE numeter;
GRANT ALL ON numeter.* TO numeter@'localhost' IDENTIFIED BY 'yourpass';

sed -i -re '
  s/^engine.*/engine = django.db.backends.mysql/ ;
  s/^name.*/name = numeter/ ;
  s/^user.*/user = numeter/ ;
  s/^password.*/password = yourpass/ ;
  s/^host.*/host = localhost/ ;
  s/^port.*/port = 3306/' /etc/numeter/numeter_webapp.cfg

apt-get install sqlite3

vim /etc/numeter/numeter_webapp.cfg

numeter-webapp syncdb

numeter-webapp runserver 0.0.0.0:8000

apt-get install libapache2-mod-wsgi
a2enmod wsgi

cp web-app/extras/numeter-apache.example /etc/apache2/sites-available/numeter-webapp
# For packaged setup /usr/share/doc/numeter/webapp/numeter-webapp
RESTFW_DIR=$(dirname $(python -c 'import rest_framework;print rest_framework.__file__'))
NUMETER_DIR=$(dirname $(python -c 'import numeter_webapp;print numeter_webapp.__file__'))
sed -i "s#@APP_DIR@#$NUMETER_DIR# ; "s#@RESTFW_DIR@#$RESTFW_DIR# ; s/ServerName.*/ServerName YoursServer/" /etc/apache2/sites-available/numeter-webapp
a2ensite numeter-webapp

apt-get install nginx uwsgi uwsgi-plugin-python

NUMETER_DIR=$(dirname $(python -c 'import numeter_webapp;print numeter_webapp.__file__'))
# Nginx
cp web-app/extras/numeter-nginx.example /etc/nginx/sites-available/numeter-webapp
ln -s /etc/nginx/sites-available/numeter-webapp /etc/nginx/sites-enabled/
sed -i "s#@APP_DIR@#$NUMETER_DIR#g" /etc/nginx/sites-available/numeter-webapp
/etc/init.d/nginx restart
# uwsgi
cp web-app/extras/numeter_webapp.ini.example /etc/uwsgi/apps-available/numeter_webapp.ini
ln -s /etc/uwsgi/apps-available/numeter_webapp.ini /etc/uwsgi/apps-enabled/
sed -i "s#@APP_DIR@#$NUMETER_DIR#g" /etc/uwsgi/apps-available/numeter_webapp.ini
/etc/init.d/uwsgi restart

apt-get install memcached python-memcache

sed -i 's/use_cache.*=.*/use_cache = True/' /etc/numeter/numeter_webapp.cfg

First launch¶

numeter-webapp syncdb
numeter-webapp storage add --name=local_storage --port=8080 --url_prefix=/numeter-storage --address=127.0.0.1

Launch your Web frontend or simply numeter-webapp runserver 0.0.0.0:80. You must add hosts in database for use it, go to ‘Configuration/Storage/YourStorage/’ and click on button Create hosts.

numeter.queue.client¶

class numeter.queue.client.BaseAPIClient(transport)¶

Bases: oslo_messaging.rpc.client.RPCClient

__init__(transport)¶

__module__ = 'numeter.queue.client'¶

ping(context, topic, args=None)¶

poller_msg(context, topic, args=None)¶

numeter.queue.client.get_rpc_client(hosts=[], password='guest')¶

numeter.queue¶

numeter.queue.server¶

class numeter.queue.server.OverrideMessageHandlingServer(transport, dispatcher, executor='blocking')¶

Bases: oslo_messaging.server.MessageHandlingServer

override MessageHandlingServer to bind multiple topics

__module__ = 'numeter.queue.server'¶

start()¶

class numeter.queue.server.Targets(targets)¶

Bases: oslo_messaging.target.Target

Target objects with additionnal targets

__init__(targets)¶

__module__ = 'numeter.queue.server'¶

numeter.queue.server._get_rpc_server(transport, target, endpoints, executor='blocking', serializer=None)¶

numeter.queue.server.get_rpc_server(topics, server, hosts, endpoints, password='guest')¶

numeter.redis¶

class numeter.redis.RedisConnect(host='127.0.0.1', port=6379, socket_timeout=2, password=None, db=0)¶

Bases: object

Frontend redis avec try sur les get

__dict__ = dict_proxy({'redis_hmset': <function redis_hmset at 0x7f8978a05578>, '__module__': 'numeter.redis', 'redis_hmget': <function redis_hmget at 0x7f8978a055f0>, 'redis_zadd': <function redis_zadd at 0x7f8978a05398>, 'redis_keys': <function redis_keys at 0x7f8978a052a8>, 'redis_hget': <function redis_hget at 0x7f8978a05668>, 'redis_set': <function redis_set at 0x7f8978a051b8>, '__dict__': <attribute '__dict__' of 'RedisConnect' objects>, 'redis_hexists': <function redis_hexists at 0x7f8978a056e0>, '__weakref__': <attribute '__weakref__' of 'RedisConnect' objects>, '__init__': <function __init__ at 0x7f8978a07f50>, 'redis_zremrangebyscore': <function redis_zremrangebyscore at 0x7f8978a05488>, 'redis_hkeys': <function redis_hkeys at 0x7f8978a057d0>, 'redis_hgetall': <function redis_hgetall at 0x7f8978a058c0>, 'redis_hdel': <function redis_hdel at 0x7f8978a05758>, 'redis_info': <function redis_info at 0x7f8978a05320>, 'redis_hlen': <function redis_hlen at 0x7f8978a05140>, 'redis_zcount': <function redis_zcount at 0x7f8978a050c8>, 'redis_get': <function redis_get at 0x7f8978a05230>, 'redis_zrangebyscore': <function redis_zrangebyscore at 0x7f8978a05410>, 'redis_hvals': <function redis_hvals at 0x7f8978a05848>, 'redis_hset': <function redis_hset at 0x7f8978a05500>, 'redis_connect': <function redis_connect at 0x7f8978a05050>, '__doc__': 'Frontend redis avec try sur les get'})¶

__init__(host='127.0.0.1', port=6379, socket_timeout=2, password=None, db=0)¶

__module__ = 'numeter.redis'¶

__weakref__¶

list of weak references to the object (if defined)

redis_connect()¶

redis_get(key)¶

redis_hdel(name, key)¶

redis_hexists(name, key)¶

redis_hget(name, key)¶

redis_hgetall(name)¶

redis_hkeys(name)¶

redis_hlen(name)¶

redis_hmget(name, key)¶

redis_hmset(name, mapping)¶

redis_hset(name, key, value)¶

redis_hvals(name)¶

redis_info()¶

redis_keys(key)¶

redis_set(key, value)¶

redis_zadd(name, value, score)¶

redis_zcount(name, valmin, valmax)¶

redis_zrangebyscore(name, valmin, valmax, start=None, num=None)¶

redis_zremrangebyscore(name, valmin, valmax)¶

numeter.storage.numeter_storage_endpoints¶

class numeter.storage.numeter_storage_endpoints.StorageEndpoint(storage)¶

Bases: object

__dict__ = dict_proxy({'__module__': 'numeter.storage.numeter_storage_endpoints', 'poller_msg': <function poller_msg at 0x7f89788df9b0>, '__dict__': <attribute '__dict__' of 'StorageEndpoint' objects>, '__weakref__': <attribute '__weakref__' of 'StorageEndpoint' objects>, '_call_write_data': <function _call_write_data at 0x7f89788dfa28>, 'ping': <function ping at 0x7f8978a059b0>, '_call_write_info': <function _call_write_info at 0x7f89788dfaa0>, '__init__': <function __init__ at 0x7f8978db6320>, '__doc__': None})¶

__init__(storage)¶

__module__ = 'numeter.storage.numeter_storage_endpoints'¶

__weakref__¶

list of weak references to the object (if defined)

_call_write_data(ctxt, args)¶

_call_write_info(ctxt, args)¶

ping(ctxt, args)¶

poller_msg(ctxt, args)¶

numeter.storage.numeter_storage¶

class numeter.storage.numeter_storage.Storage(configFile='/etc/numeter_storage.cfg')¶

Bases: object

__dict__ = dict_proxy({'__module__': 'numeter.storage.numeter_storage', '_get_host_list': <function _get_host_list at 0x7f8978868aa0>, 'jsonToPython': <function jsonToPython at 0x7f8978868b90>, 'redisStartConnexion': <function redisStartConnexion at 0x7f89788689b0>, 'readConf': <function readConf at 0x7f8978868f50>, '_write_data': <function _write_data at 0x7f8978868c80>, 'cleanInfo': <function cleanInfo at 0x7f8978868de8>, 'cleanOldWSP': <function cleanOldWSP at 0x7f8978868ed8>, '__dict__': <attribute '__dict__' of 'Storage' objects>, '__weakref__': <attribute '__weakref__' of 'Storage' objects>, '__init__': <function __init__ at 0x7f89788688c0>, 'pythonToJson': <function pythonToJson at 0x7f8978868c08>, '_write_info': <function _write_info at 0x7f8978868d70>, '_get_hostIDHash': <function _get_hostIDHash at 0x7f8978868cf8>, 'startStorage': <function startStorage at 0x7f8978868938>, 'getgloballog': <function getgloballog at 0x7f8978868a28>, 'paramsVerification': <function paramsVerification at 0x7f8978868b18>, 'cleanHosts': <function cleanHosts at 0x7f8978868e60>, '__doc__': None})¶

__init__(configFile='/etc/numeter_storage.cfg')¶

__module__ = 'numeter.storage.numeter_storage'¶

__weakref__¶

list of weak references to the object (if defined)

_get_hostIDHash(hostID)¶

Get cached hostID hash or add in cache

_get_host_list()¶

Get host list

_write_data(hostID, plugin, data_json)¶

_write_info(hostID, info_json)¶

cleanHosts(writedHosts)¶

Clean info in redis and wsp

cleanInfo(writedInfos, hostID)¶

Clean info in redis and wsp

cleanOldWSP()¶

Clean old wsps

getgloballog()¶

Init du logger (fichier et stdr)

jsonToPython(data)¶

Convert json to python

paramsVerification()¶

Args verification

pythonToJson(data)¶

Convert python to json

readConf()¶

Read configuration file

redisStartConnexion()¶

startStorage()¶

Start storage

numeter.poller.munin_connect¶

class numeter.poller.munin_connect.MuninConnection(munin_host='127.0.0.1', munin_port=4949)¶

Bases: object

Read lines from MuninSock. Provide also basic munin-node commandes :

• Config
• Fetch
• List
• Nodes

__dict__ = dict_proxy({'__module__': 'numeter.poller.munin_connect', '_iterline': <function _iterline at 0x7f8978485c80>, '__weakref__': <attribute '__weakref__' of 'MuninConnection' objects>, 'munin_list': <function munin_list at 0x7f8978485d70>, 'munin_nodes': <function munin_nodes at 0x7f8978485de8>, 'munin_config': <function munin_config at 0x7f8978485e60>, '__dict__': <attribute '__dict__' of 'MuninConnection' objects>, 'munin_fetch': <function munin_fetch at 0x7f8978485cf8>, '_readline': <function _readline at 0x7f8978485c08>, '__doc__': 'Read lines from ``MuninSock``. Provide also basic munin-node commandes :\n\n * Config\n * Fetch\n * List\n * Nodes', '__init__': <function __init__ at 0x7f8978485b90>})¶

__init__(munin_host='127.0.0.1', munin_port=4949)¶

__module__ = 'numeter.poller.munin_connect'¶

__weakref__¶

list of weak references to the object (if defined)

_iterline()¶

_readline()¶

munin_config(key)¶

munin_fetch(key)¶

munin_list()¶

munin_nodes()¶

class numeter.poller.munin_connect.MuninSock(host, port)¶

Bases: object

Open and close a socket with munin-node socket. This class allow you to use with statement (for python < 3).

with MuninSock(self.munin_host, self.munin_port) as sock:
  ...

__dict__ = dict_proxy({'__module__': 'numeter.poller.munin_connect', '__exit__': <function __exit__ at 0x7f8978485b18>, '__enter__': <function __enter__ at 0x7f8978485aa0>, '__dict__': <attribute '__dict__' of 'MuninSock' objects>, '__weakref__': <attribute '__weakref__' of 'MuninSock' objects>, '__doc__': 'Open and close a socket with munin-node socket. This class allow you\n to use ``with`` statement (for python < 3).\n\n ::\n\n with MuninSock(self.munin_host, self.munin_port) as sock:\n ...', '__init__': <function __init__ at 0x7f8978485a28>})¶

__enter__()¶

Open socket with munin-node

__exit__(type, value, traceback)¶

Close socket with munin-node

__init__(host, port)¶

• host : munin-node host
• port : munin-node port

__module__ = 'numeter.poller.munin_connect'¶

__weakref__¶

list of weak references to the object (if defined)

numeter.poller.storeandforward¶

class numeter.poller.storeandforward.StoreAndForward(cache_file='/dev/shm/store_and_forward.json', logger='numeter.poller.storeandforward')¶

Bases: object

Use case exemple :

Init logging level with debug stream handler:

logging.getLogger('StoreAndForward').setLevel(logging.INFO)
logging.getLogger('StoreAndForward').addHandler(logging.StreamHandler())

from time import time

with StoreAndForward(cache_file='./sandbox/cache_storeandforward.json') as cache :

    # Add stored message
    cache.add_message('DATA', 'munin.if_eth0.up', '{%s content}' % time())

    Read stored message
    for message in cache.consume():
        print message

__dict__ = dict_proxy({'__module__': 'numeter.poller.storeandforward', '_load_cache': <function _load_cache at 0x7f8978830ed8>, '__exit__': <function __exit__ at 0x7f8978830de8>, '_dump_cache': <function _dump_cache at 0x7f8978830f50>, 'add_message': <function add_message at 0x7f8978830e60>, '__enter__': <function __enter__ at 0x7f8978830d70>, '__dict__': <attribute '__dict__' of 'StoreAndForward' objects>, '__weakref__': <attribute '__weakref__' of 'StoreAndForward' objects>, '__doc__': "\n Use case exemple :\n\n Init logging level with debug stream handler::\n\n logging.getLogger('StoreAndForward').setLevel(logging.INFO)\n logging.getLogger('StoreAndForward').addHandler(logging.StreamHandler())\n\n from time import time\n\n with StoreAndForward(cache_file='./sandbox/cache_storeandforward.json') as cache :\n\n # Add stored message\n cache.add_message('DATA', 'munin.if_eth0.up', '{%s content}' % time())\n\n Read stored message\n for message in cache.consume():\n print message\n ", '__init__': <function __init__ at 0x7f8978830cf8>, 'consume': <function consume at 0x7f8978485050>})¶

__enter__()¶

__exit__(type, value, traceback)¶

__init__(cache_file='/dev/shm/store_and_forward.json', logger='numeter.poller.storeandforward')¶

__module__ = 'numeter.poller.storeandforward'¶

__weakref__¶

list of weak references to the object (if defined)

_dump_cache()¶

_load_cache()¶

add_message(msgType, plugin, msgContent)¶

consume()¶

numeter.poller.muninModule¶

class numeter.poller.muninModule.MuninModule(configParser=None)¶

Bases: numeter.poller.modulesGeneric.ModulesGeneric

This poller module fetch configs and datas from a munin-node daemon.

Configuration section for this module :

[MuninModule]
plugins_enable = ^.*$    ; Regexp matching plugins to fetch
munin_host = 127.0.0.1   ; Munin Host
munin_port = 4949        ; Munin Port

__init__(configParser=None)¶

When numeter load a module, the only one parameter is the config parser. It’s allow you to add section in numeter config file for your own module.

__module__ = 'numeter.poller.muninModule'¶

formatFetchData(plugin)¶

Execute a munin fetch for a given plugin name. Get the result and format the raw result for getData :

data = {  'TimeStamp': nowTimestamp,
           'Plugin': plugin,
           'Values': pluginData
}

formatFetchInfo(plugin)¶

Execute a munin config for a given plugin name. Get the result and format the raw result for getInfo :

infos =  {    'Plugin': plugin,
              'Base': '1000',
              'Describ': '',
              'Title': plugin,
              'Vlabel': '',
              'Order': '',
              'Infos': {}
         }

getData()¶

get and return all datas collected from munin-node. See modulesGeneric return format

For each plugin matching plugins_enable regex in the config file, launch formatFetchData and append result to getData output

getInfo()¶

get and return all infos collected from munin-node. See modulesGeneric return format

For each plugin matching plugins_enable regex in the config file, launch formatFetchInfo and append result to getInfo output

getParserConfig()¶

Read MuninModule from configParser

numeter.poller.cachelastvalue¶

class numeter.poller.cachelastvalue.CacheLastValue(cache_file='/dev/shm/cache_last_value.json', logger='numeter.poller.cachelastvalue')¶

Bases: object

__dict__ = dict_proxy({'__module__': 'numeter.poller.cachelastvalue', '_load_cache': <function _load_cache at 0x7f8978830aa0>, '__exit__': <function __exit__ at 0x7f8978830a28>, '_dump_cache': <function _dump_cache at 0x7f8978830b18>, '__enter__': <function __enter__ at 0x7f89788309b0>, 'get_value': <function get_value at 0x7f8978830c08>, 'save_value': <function save_value at 0x7f8978830b90>, '__dict__': <attribute '__dict__' of 'CacheLastValue' objects>, '__weakref__': <attribute '__weakref__' of 'CacheLastValue' objects>, '__doc__': None, '__init__': <function __init__ at 0x7f8978830938>})¶

__enter__()¶

__exit__(type, value, traceback)¶

__init__(cache_file='/dev/shm/cache_last_value.json', logger='numeter.poller.cachelastvalue')¶

__module__ = 'numeter.poller.cachelastvalue'¶

__weakref__¶

list of weak references to the object (if defined)

_dump_cache()¶

_load_cache()¶

get_value(key)¶

save_value(key, timestamp, value)¶

numeter.poller.numeter_poller¶

class numeter.poller.numeter_poller.Poller(configFile='/etc/numeter_poller.cfg')¶

Bases: object

__dict__ = dict_proxy({'__module__': 'numeter.poller.numeter_poller', 'getMyInfo': <function getMyInfo at 0x7f8978485488>, '_store_and_forward_sendMsg': <function _store_and_forward_sendMsg at 0x7f8978485230>, '__dict__': <attribute '__dict__' of 'Poller' objects>, '_sendMsg': <function _sendMsg at 0x7f89784852a8>, '_sendData': <function _sendData at 0x7f89784851b8>, 'loadModules': <function loadModules at 0x7f8978485410>, 'getgloballog': <function getgloballog at 0x7f8978485500>, 'readConf': <function readConf at 0x7f89784855f0>, 'convertToJson': <function convertToJson at 0x7f8978485140>, 'writeInSimulateFile': <function writeInSimulateFile at 0x7f8978485398>, 'pollerTimeToGo': <function pollerTimeToGo at 0x7f8978485578>, '_sendInfo': <function _sendInfo at 0x7f8978485320>, '__weakref__': <attribute '__weakref__' of 'Poller' objects>, '__doc__': None, '__init__': <function __init__ at 0x7f8978830c80>, 'startPoller': <function startPoller at 0x7f89784850c8>})¶

__init__(configFile='/etc/numeter_poller.cfg')¶

__module__ = 'numeter.poller.numeter_poller'¶

__weakref__¶

list of weak references to the object (if defined)

_sendData(allDatas)¶

Send data in rpc

_sendInfo(allInfos)¶

Send info in rpc

_sendMsg(msgType, plugin, msgContent)¶

_store_and_forward_sendMsg(msgType, plugin, msgContent)¶

convertToJson(data)¶

Convert data to json

getMyInfo()¶

Read my infos in conf file

getgloballog()¶

Init logger (file and stdr)

loadModules()¶

Get and write data / infos of all modules

pollerTimeToGo()¶

LAST + poller_time <= NOW calcule aussi le refresh time

readConf()¶

Read configuration file

startPoller()¶

Start the poller

writeInSimulateFile(message)¶

Write in simulate file

numeter.poller.modulesGeneric¶

class numeter.poller.modulesGeneric.ModulesGeneric(configParser=None)¶

Bases: object

Module generic is the skeleton to build your own numeter module. If you want to write your own numeter module, you can take this class and build your own with it.

__dict__ = dict_proxy({'__module__': 'numeter.poller.modulesGeneric', 'getInfo': <function getInfo at 0x7f8978485758>, '__dict__': <attribute '__dict__' of 'ModulesGeneric' objects>, 'getData': <function getData at 0x7f89784857d0>, '__weakref__': <attribute '__weakref__' of 'ModulesGeneric' objects>, '__doc__': 'Module generic is the skeleton to build your own numeter module.\n If you want to write your own numeter module, you can take this\n class and build your own with it.\n ', '__init__': <function __init__ at 0x7f89784856e0>})¶

__init__(configParser=None)¶

When numeter load a module, the only one parameter is the config parser. It’s allow you to add section in numeter config file for your own module.

__module__ = 'numeter.poller.modulesGeneric'¶

__weakref__¶

list of weak references to the object (if defined)

getData()¶

Get and return all collected datas. The output must be formated like that :

data=   [{      'TimeStamp': 1410907894,
                'Plugin': 'if',
                'Values': {
                            'up' : 40,
                            'down' : 15,
                          }
        }]

getInfo()¶

Return for all datas you have collected. The output must be formated like that :

infos=   [{   'Plugin': 'if',
              'Base': '1000',
              'Describ': '',
              'Title': 'if eth0',
              'Vlabel': '',
              'Order': '',
              'Infos': {
                    "down":{"type": "COUNTER", "id": "down", "label": "received"},
                    "up":{"type": "COUNTER", "id": "up", "label": "upload"},
              }
         }]

Warning

Each DataSource (each datas) you define in getData must have at least an entry in getInfo return like "id":{"id": "up"}