Instalacny manual pre BasicMeter v1.0RC2

Priprava

1.) nainstalovat screen: sudo apt-get install screen

2.) editovat subor vim /etc/apt/sources.list a doplnit repozitar multiverse

3.) nezabudnut na sudo apt-get update

Instalacia kolektora

4.) stiahnut z wiki .deb balicek

wget http://wiki.cnl.tuke.sk/pub/Monica/PrvyRelease/jxcoll_3.1-8_i386.deb

5.) spustit prikaz sudo dpkg -i jxcoll_3.1-8_i386.deb Toto balicek este nenainstaluje, vyhlasi dependency problems, pretoze balicek zavisi na inych balickoch, ktore este nie su nainstalovane.

6.) dependency problems odstranit pomocou sudo apt-get -f install (nainstaluje vsetky balicky potrebne pre beh jxcoll_3.1-8)

7.) nainstalovat .deb balicek pomocou sudo dpkg -i jxcoll_3.1-8_i386.deb

7.5) ak by sa z akychkolvek dovodov nenainstalovalo JRE (.deb balicek stale vyhlasuje dependency problems), treba ho nainstalovat manualne pomocou sudo apt-get install sun-java6-jre

Instalacia exportera

8.) stiahnut z wiki .deb balicek =wget http://wiki.cnl.tuke.sk/pub/Monica/PrvyRelease/mybeem_1.0-1_i386x.deb=

9.) spustit prikaz dpkg -i mybeem_1.0-1_i386x.deb Opat dependency problems,

10.) ktore sa odstrania prikazom sudo apt-get -f install

11.) nainstalovat .deb balicek pomocou dpkg -i mybeem_1.0-1_i386x.deb

Vytvorenie databazy a tabuliek

12.) pokracovat podla postgresql howto od Ada Pekara:

#!Postgresql howto for MONICA!
#!CREATED BY ADRIAN PEKAR 2009!

sudo apt-get install postgresql pgadmin3
#attention! this will install the latest avaliable version of postgresql (8.4)!

sudo -u postgres createuser -D -A -P -l bm 
#(D)d (no)NewDatabase
#(A)a (no)AddUser
#P promptForPassword
#(R)r (no)createRole
#(L)l (not)allowedToLogin
#bm - mynewuser

sudo -u postgres createdb -O bm bm
#O owner
#bm - mynewuser
#bm - mydatabase

psql -h 127.0.0.1 -d bm -U bm
#where
#-h is the host or address of the location where the database is
#-U is the user name
#-d is the database name
#password will be requested in the next step (bm)

13.) po prihlaseni do databazy vytvorit nasledujuce tabulky:

CREATE TABLE records_main (
  RID                            bigserial NOT NULL,
  sourceIPv4Address              inet,
  destinationIPv4Address         inet,
  sourceTransportPort            int4,
  destinationTransportPort       int4,
  protocolIdentifier             int2,
  octetTotalCount                numeric(22),
  packetTotalCount               numeric(22),
  octetDeltaCount                numeric(22),
  packetDeltaCount               numeric(22),
  flowStartSeconds               numeric(22),
  flowEndSeconds                 numeric(22),
  PRIMARY KEY(RID)
);


CREATE TABLE records_scope (
  ID                                       bigserial NOT NULL,
  RID                                      bigint REFERENCES records_main ON UPDATE CASCADE ON DELETE
CASCADE NOT NULL,
  lineCardId                               int8,
  portId                                   int8,
  ingressInterface                         int8,
  egressInterface                          int8,
  meteringProcessId                        int8,
  exportingProcessId                       int8,
  flowId                                   numeric(22),
  templateId                               int4,
  observationDomainId                      int8,
  observationPointId                       int8,
  commonPropertiesId                       numeric(22),
  PRIMARY KEY(ID)
);


CREATE TABLE records_config (
  ID                                       bigserial NOT NULL,
  RID                                      bigint REFERENCES records_main ON UPDATE CASCADE ON DELETE
CASCADE NOT NULL,
  exporterIPv4Address                      inet,
  exporterIPv6Address                      inet,
  exporterTransportPort                    int4,
  collectorIPv4Address                     inet,
  collectorIPv6Address                     inet,
  collectorInterface                       int8,
  collectorProtocolVersion                 int2,
  collectorTransportProtocol               int2,
  collectorTransportPort                   int4,
  flowKeyIndicator                         numeric(22),
  PRIMARY KEY(ID)
);


CREATE TABLE records_processCounter (
  ID                                       bigserial NOT NULL,
  RID                                      bigint REFERENCES records_main ON UPDATE CASCADE ON DELETE
CASCADE NOT NULL,
  exportedMessageTotalCount                numeric(22),
  exportedOctetTotalCount                  numeric(22),
  exportedFlowRecordTotalCount             numeric(22),
  observedFlowTotalCount                   numeric(22),
  ignoredPacketTotalCount                  numeric(22),
  ignoredOctetTotalCount                   numeric(22),
  notSentFlowTotalCount                    numeric(22),
  notSentPacketTotalCount                  numeric(22),
  notSentOctetTotalCount                   numeric(22),
  PRIMARY KEY(ID)
);


CREATE TABLE records_ipHeader (
  ID                                       bigserial NOT NULL,
  RID                                      bigint REFERENCES records_main ON UPDATE CASCADE ON DELETE
CASCADE NOT NULL,
  ipVersion                                int2,
  sourceIPv6Address                        inet,
  sourceIPv4PrefixLength                   int2,
  sourceIPv6PrefixLength                   int2,
  sourceIPv4Prefix                         inet,
  sourceIPv6Prefix                         inet,
  destinationIPv6Address                   inet,
  destinationIPv4PrefixLength              int2,
  destinationIPv6PrefixLength              int2,
  destinationIPv4Prefix                    inet,
  destinationIPv6Prefix                    inet,
  ipTTL                                    int2,
  nextHeaderIPv6                           int2,
  ipDiffServCodePoint                      int2,
  ipPrecedence                             int2,
  ipClassOfService                         int2,
  postIpClassOfService                     int2,
  flowLabelIPv6                            int8,
  isMulticast                              int2,
  fragmentIdentification                   int8,
  fragmentOffset                           int4,
  fragmentFlags                            int2,
  ipHeaderLength                           int2,
  ipv4IHL                                  int2,
  totalLengthIPv4                          int4,
  ipTotalLength                            numeric(22),
  payloadLengthIPv6                        int4,
  PRIMARY KEY(ID)
);


CREATE TABLE records_transportHeader (
  ID                                       bigserial NOT NULL,
  RID                                      bigint REFERENCES records_main ON UPDATE CASCADE ON DELETE
CASCADE NOT NULL,
  udpSourcePort                            int4,
  udpDestinationPort                       int4,
  udpMessageLength                         int4,
  tcpSourcePort                            int4,
  tcpDestinationPort                       int4,
  tcpSequenceNumber                        int8,
  tcpAcknowledgementNumber                 int8,
  tcpWindowSize                            int4,
  tcpWindowScale                           int4,
  tcpUrgentPointer                         int4,
  tcpHeaderLength                          int2,
  icmpTypeCodeIPv4                         int4,
  icmpTypeIPv4                             int2,
  icmpCodeIPv4                             int2,
  icmpTypeCodeIPv6                         int4,
  icmpTypeIPv6                             int2,
  icmpCodeIPv6                             int2,
  igmpType                                 int2,
  PRIMARY KEY(ID)
);


CREATE TABLE records_subIpHeader            (
  ID                                       bigserial NOT NULL,
  RID                                      bigint REFERENCES records_main ON UPDATE CASCADE ON DELETE
CASCADE NOT NULL,
  sourceMacAddress                         macaddr,
  postSourceMacAddress                     macaddr,
  vlanId                                   int4,
  postVlanId                               int4,
  destinationMacAddress                    macaddr,
  postDestinationMacAddress                macaddr,
  wlanChannelId                            int2,
  wlanSSID                                 text,
  mplsTopLabelTTL                          int2,
  mplsTopLabelExp                          int2,
  postMplsTopLabelExp                      int2,
  mplsLabelStackDepth                      int8,
  mplsLabelStackLength                     int8,
  mplsPayloadLength                        int8,
  mplsTopLabelStackSection                 bit varying,
  mplsLabelStackSection2                   bit varying,
  mplsLabelStackSection3                   bit varying,
  mplsLabelStackSection4                   bit varying,
  mplsLabelStackSection5                   bit varying,
  mplsLabelStackSection6                   bit varying,
  mplsLabelStackSection7                   bit varying,
  mplsLabelStackSection8                   bit varying,
  mplsLabelStackSection9                   bit varying,
  mplsLabelStackSection10                  bit varying,
  PRIMARY KEY(ID)
);


CREATE TABLE records_derived (
  ID                                       bigserial NOT NULL,
  RID                                      bigint REFERENCES records_main ON UPDATE CASCADE ON DELETE
CASCADE NOT NULL,
  ipPayloadLength                          int8,
  ipNextHopIPv4Address                     inet,
  ipNextHopIPv6Address                     inet,
  bgpSourceAsNumber                        int8,
  bgpDestinationAsNumber                   int8,
  bgpNextAdjacentAsNumber                  int8,
  bgpPrevAdjacentAsNumber                  int8,
  bgpNextHopIPv4Address                    inet,
  bgpNextHopIPv6Address                    inet,
  mplsTopLabelType                         int2,
  mplsTopLabelIPv4Address                  inet,
  mplsTopLabelIPv6Address                  inet,
  mplsVpnRouteDistinguisher                bit varying,
  PRIMARY KEY(ID)
);


CREATE TABLE records_minMax (
  ID                                       bigserial NOT NULL,
  RID                                      bigint REFERENCES records_main ON UPDATE CASCADE ON DELETE
CASCADE NOT NULL,
  minimumIpTotalLength                     numeric(22),
  maximumIpTotalLength                     numeric(22),
  minimumTTL                               int2,
  maximumTTL                               int2,
  ipv4Options                              int8,
  ipv6ExtensionHeaders                     int8,
  tcpControlBits                           int2,
  tcpOptions                               numeric(22),
  PRIMARY KEY(ID)
);


CREATE TABLE records_timestamp (
  ID                             bigserial NOT NULL,
  RID                            bigint REFERENCES records_main ON UPDATE CASCADE ON DELETE
CASCADE NOT NULL,
  flowStartMilliseconds          numeric(22),
  flowEndMilliseconds            numeric(22),
  flowStartMicroseconds          numeric(22),
  flowEndMicroseconds            numeric(22),
  flowStartNanoseconds           numeric(22),
  flowEndNanoseconds             numeric(22),
  flowStartDeltaMicroseconds     int8,
  flowEndDeltaMicroseconds       int8,
  systemInitTimeMilliseconds     numeric(22),
  flowStartSysUpTime             int8,
  flowEndSysUpTime               int8,
  PRIMARY KEY(ID)
);


CREATE TABLE records_flowCounter  (
  ID                             bigserial NOT NULL,
  RID                            bigint REFERENCES records_main ON UPDATE CASCADE ON DELETE
CASCADE NOT NULL,
  postOctetDeltaCount            numeric(22),
  octetDeltaSumOfSquares         numeric(22),
  postOctetTotalCount            numeric(22),
  octetTotalSumOfSquares         numeric(22),
  postPacketDeltaCount           numeric(22),
  postPacketTotalCount           numeric(22),
  droppedOctetDeltaCount         numeric(22),
  droppedPacketDeltaCount        numeric(22),
  droppedOctetTotalCount         numeric(22),
  droppedPacketTotalCount        numeric(22),
  postMCastPacketDeltaCount      numeric(22),
  postMCastOctetDeltaCount       numeric(22),
  postMCastPacketTotalCount      numeric(22),
  postMCastOctetTotalCount       numeric(22),
  tcpSynTotalCount               numeric(22),
  tcpFinTotalCount               numeric(22),
  tcpRstTotalCount               numeric(22),
  tcpPshTotalCount               numeric(22),
  tcpAckTotalCount               numeric(22),
  tcpUrgTotalCount               numeric(22),
  PRIMARY KEY(ID)
);


CREATE TABLE records_misc (
  ID                             bigserial NOT NULL,
  RID                            bigint REFERENCES records_main ON UPDATE CASCADE ON DELETE
CASCADE NOT NULL,
  flowActiveTimeout              int4,
  flowIdleTimeout                int4,
  flowEndReason                  int2,
  flowDurationMilliseconds       int8,
  flowDurationMicroseconds       int8,
  flowDirection                  int2,
  PRIMARY KEY(ID)
);


CREATE TABLE records_padding (
  ID                             bigserial NOT NULL,
  RID                            bigint REFERENCES records_main ON UPDATE CASCADE ON DELETE
CASCADE NOT NULL,
  paddingOctets            bit varying,
  PRIMARY KEY(ID)
);


CREATE TABLE records_cnlinformationelements (
   ID                             bigserial NOT NULL,
   RID                            bigint REFERENCES records_main ON UPDATE CASCADE ON DELETE CASCADE NOT NULL,
   roundTripTimeNanoseconds       numeric(22),
   packetPairsTotalCount          numeric(22),
   hostnameOrIP                   text,
   ipCount                        numeric(22),
   objectsSize                    numeric(22),
   userBrowser                    text,
   operationSystem                text,
   PRIMARY KEY(ID)
);


CREATE SEQUENCE acc_seq START 1;


CREATE TABLE acc_user (
  id            int4                    not null default nextval('acc_seq'),
  name          character varying(32)   not null,
  organization  character varying(64)   not null,
  address       character varying(128)  not null,
  phone         character varying(16),
  mobile        character varying(16),
  email         character varying(64),
  ipaddresses   character varying(256)  not null,
  ico           character varying(8),
  dic           character varying(8),
  accountno     character varying(16),
  active        boolean,
  PRIMARY KEY(id)
);


CREATE TABLE acc_record (
 user_id                 int4                      REFERENCES acc_user ON DELETE CASCADE NOT NULL,
 sourceipv4address       inet                      not null,
 destinationipv4address  inet                      not null,
 protocolidentifier      int2,
 sourceport              int4,
 destinationport         int4,
 ipdiffservcodepoint     int2,
 datetime                timestamp without time zone  not null,
 ismulticast             boolean,
 octettotalcount         int8                       not null,
 packettotalcount        int8                       not null,
 flowcount               int4
);


CREATE INDEX ix_datetime ON acc_record (datetime);


CREATE SEQUENCE criteria_seq START 1;


CREATE TABLE acc_criteria (
 id                      int4                  default nextval('criteria_seq'),
 user_id                 int4                  REFERENCES acc_user ON DELETE CASCADE NOT NULL,
 sourceipaddresses       character varying(1024),
 destinationipaddresses  character varying(1024),
 protocol                character varying(3)  CONSTRAINT chck_protocol CHECK (protocol = 'tcp' OR protocol = 'udp' OR protocol = 'any'),
 sourceports             character varying(1024),
 destinationports        character varying(1024),
 dscp                    character varying(1024),
 multicast               boolean,
 rate                    real                  not null,
 priority                int4                  not null,
 PRIMARY KEY(id)
);


ALTER TABLE acc_criteria OWNER TO bm;

ALTER TABLE acc_record OWNER TO bm;

ALTER TABLE acc_user OWNER TO bm;

ALTER TABLE records_cnlinformationelements OWNER TO bm;

ALTER TABLE records_config OWNER TO bm;

ALTER TABLE records_derived OWNER TO bm;

ALTER TABLE records_flowcounter OWNER TO bm;

ALTER TABLE records_ipheader OWNER TO bm;

ALTER TABLE records_main OWNER TO bm;

ALTER TABLE records_minmax OWNER TO bm;

ALTER TABLE records_misc OWNER TO bm;

ALTER TABLE records_padding OWNER TO bm;

ALTER TABLE records_processcounter OWNER TO bm;

ALTER TABLE records_scope OWNER TO bm;

ALTER TABLE records_subipheader OWNER TO bm;

ALTER TABLE records_timestamp OWNER TO bm;

ALTER TABLE records_transportheader OWNER TO bm;


CREATE TABLE netflow (
   "IPV4_SRC_ADDR" inet NOT NULL,
   "IPV4_DST_ADDR" inet NOT NULL,
   "IPV4_NEXT_HOP" inet,
   "IN_PKTS" integer,
   "IN_BYTES" integer,
   "FIRST_SWITCHED" timestamp without time zone NOT NULL,
   "LAST_SWITCHED" timestamp without time zone NOT NULL,
   "L4_SRC_PORT" integer,
   "L4_DST_PORT" integer,
   "TCP_FLAGS" integer,
   "PROTOCOL" integer,
   "SRC_TOS" integer,
   "INPUT_SNMP" integer,
   "OUTPUT_SNMP" integer,
   ts bigint,
   pkt_id double precision,
   "SAMPLING_INTERVAL" integer,
   "SAMPLING_ALGORITHM" integer,
   "IP_MP" inet NOT NULL,
   ts_mp timestamp without time zone NOT NULL,
   nf_ver smallint NOT NULL
);


#this is needed for accounting analyser values:

insert into ACC_USER values (1,'defaultUser','CNL','Letna 9','23321','0092', 'adrian.pekar@gmail.com', '192.168.1.1','234234','2342342','1/1234','true');

14.) skontrolovat, ci su tabulky vytvorene pomocou bm=> \dt. Zoznam by mal vyzerat takto:

                    List of relations
 Schema |              Name              | Type  | Owner 
--------+--------------------------------+-------+-------
 public | acc_criteria                   | table | bm
 public | acc_record                     | table | bm
 public | acc_user                       | table | bm
 public | netflow                        | table | bm
 public | records_cnlinformationelements | table | bm
 public | records_config                 | table | bm
 public | records_derived                | table | bm
 public | records_flowcounter            | table | bm
 public | records_ipheader               | table | bm
 public | records_main                   | table | bm
 public | records_minmax                 | table | bm
 public | records_misc                   | table | bm
 public | records_padding                | table | bm
 public | records_processcounter         | table | bm
 public | records_scope                  | table | bm
 public | records_subipheader            | table | bm
 public | records_timestamp              | table | bm
 public | records_transportheader        | table | bm
(18 rows)

Pouzitie

jxcoll spusti Jxcoll (vid. man jxcoll)

man jxcoll; man jxcoll.conf manualove stranky

/etc/init.d/jxcolld daemon s operaciami start|stop|status|restart|usage/help

mybeem alebo /usr/sbin/mybeem (ak nie je nastaveny PATH na sbin), spusti mybeem s defaultnym konfigom ulozenym v /etc/mybeem/config.xml

mybeem cesta-ku-konfigu spusti mybeem s danym konf. suborom

vim /etc/mybeem/config.xml edituje konf. subor

man mybeem manualova stranka k mybeem

-- RastislavKudla - 20 Dec 2009