411 REFERENCE · Wikibooks
System Monitoring with Xymon/Developer Guide
Reference material by Wikibooks contributors. This retains its source identity and is not 411 news reporting.
Getting Started with hobbit development on sourceforge
Reference Books
C Programming
UNIX Advance programming
UNIX Network Programming
SVN tutorial
References
Getting started with SVN
GCC SVN tutorial
SVN for Xymon Tutorials
Followings are some examples using svn to interact with hobbit on sourceforge.net.
list out the sub directory of xymon SVN directory.
[tjyang@ibm hobbitmon]$ svn ls https://hobbitmon.svn.sourceforge.net/svnroot/hobbitmon
branches/
sandbox/
tags/
trunk/
[tjyang@ibm hobbitmon]$
find out changes in last 7 days.
[tjyang@ibm hobbitmon]$ svn log -v -r HEAD:\{`date +%Y-%m-%d -d'7 days ago'`\} \
https://hobbitmon.svn.sourceforge.net/svnroot/hobbitmon
------------------------------------------------------------------------
r6033 | storner | 2009-01-08 07:43:23 -0600 (Thu, 08 Jan 2009) | 1 line
Changed paths:
M /trunk/client/Makefile
Make sure client scripts are executable
------------------------------------------------------------------------
r6032 | storner | 2009-01-07 06:00:45 -0600 (Wed, 07 Jan 2009) | 1 line
Changed paths:
M /branches/4.2.3/build/md5.dat
A /branches/4.2.3/hobbitd/webfiles/hostlist_footer
A /branches/4.2.3/hobbitd/webfiles/hostlist_form
A /branches/4.2.3/hobbitd/webfiles/hostlist_header
M /branches/4.2.3/lib/headfoot.c
M /branches/4.2.3/lib/headfoot.h
M /branches/4.2.3/web/Makefile
A /branches/4.2.3/web/hobbit-hostlist.c
A /branches/4.2.3/web/hobbit-hostlist.sh.DIST
Added hostlist CGI from trunk
------------------------------------------------------------------------
r6031 | storner | 2009-01-07 05:59:22 -0600 (Wed, 07 Jan 2009) | 2 lines
Changed paths:
M /branches/4.2.3/build/generate-md5.sh
Adapted to work with Subversion and new source directories.
------------------------------------------------------------------------
r6030 | storner | 2008-12-17 05:39:49 -0600 (Wed, 17 Dec 2008) | 2 lines
Changed paths:
A /branches/4.2.3 (from /branches/4.2.2:6029)
New branch off the 4.2.2 release for maintenance - will become 4.2.3 (if needed).
------------------------------------------------------------------------
[tjyang@ibm hobbitmon]$
Checking out hobbit source tree using svn.
[tjyang@fc6 ]$ svn co https://hobbitmon.svn.sourceforge.net/svnroot/hobbitmon hobbitmon
<snip>
A hobbitmon/tags/rel_4_0-20041201/web/bb-findhost.cgi.1
A hobbitmon/tags/rel_4_0-20041201/web/bb-ack.c
A hobbitmon/tags/rel_4_0-20041201/web/hobbitsvc-trends.c
A hobbitmon/tags/rel_4_0-20041201/web/bb-snapshot.c
A hobbitmon/tags/rel_4_0-20041201/web/hobbitsvc.c
A hobbitmon/tags/rel_4_0-20041201/web/bb-eventlog.cgi.1
A hobbitmon/tags/rel_4_0-20041201/web/bb-rep.cgi.1
A hobbitmon/tags/rel_4_0-20041201/web/bb-replog.cgi.1
A hobbitmon/tags/rel_4_0-20041201/web/bb-hist.c
A hobbitmon/tags/rel_4_0-20041201/web/bb-csvinfo.c
A hobbitmon/tags/rel_4_0-20041201/web/bb-webpage.c
Checked out revision 5644.
[tjyang@fc6 hobbitmon]$ ls -la
total 28
drwxrwxr-x 6 tjyang tjyang 4096 Aug 4 09:11 .
drwxr-xr-x 38 tjyang tjyang 4096 Aug 4 09:09 ..
drwxrwxr-x 3 tjyang tjyang 4096 Aug 4 09:11 branches
drwxrwxr-x 6 tjyang tjyang 4096 Aug 4 10:04 .svn
drwxrwxr-x 67 tjyang tjyang 4096 Aug 4 10:04 tags
drwxrwxr-x 16 tjyang tjyang 4096 Aug 4 09:11 trunk
[tjyang@fc6 hobbitmon]$
to revert all the changes you made to hobbit src tree.
svn revert --recursive .
As one of hobbit developers, you can create a branch.
Following example create a instance of hobbit by tjyang.
[tjyang@fc6 hobbitmon]$ svn mkdir branches/tjyang
A branches/tjyang
[tjyang@fc6 hobbitmon]$ svn copy trunk branches/tjyang
A branches/tjyang/trunk
[tjyang@fc6 hobbitmon]$ svn commit -m "T.J. Yang's copy of hobbit"
Authentication realm: <https://hobbitmon.svn.sourceforge.net:443> SourceForge Subversion area
Password for 'tjyang':
Adding branches/tjyang
Adding branches/tjyang/trunk
Committed revision 5645.
[tjyang@fc6 hobbitmon]$
creating a subdirectory.
[tjyang@fc6 trunk]$ svn status
A pkg
M README
[tjyang@fc6 trunk]$ mkdir pkg/tww
[tjyang@fc6 trunk]$ svn status
? pkg/tww
A pkg
M README
[tjyang@fc6 trunk]$ svn add pkg/tww
A pkg/tww
[tjyang@fc6 trunk]$ pwd
/home/tjyang/hobbitmon/branches/tjyang/trunk
[tjyang@fc6 trunk]$ ls
bbdisplay bbproxy Changes common configure.client COPYING debian hobbitd lib README RELEASENOTES web
bbnet build client configure configure.server CREDITS docs include pkg README.CLIENT rpm
[tjyang@fc6 trunk]$ pwd
/home/tjyang/hobbitmon/branches/tjyang/trunk
[tjyang@fc6 trunk]$ ls
bbdisplay bbproxy Changes common configure.client COPYING debian hobbitd lib README RELEASENOTES web
bbnet build client configure configure.server CREDITS docs include pkg README.CLIENT rpm
[tjyang@fc6 trunk]$ ls
bbdisplay bbproxy Changes common configure.client COPYING debian hobbitd lib README RELEASENOTES web
bbnet build client configure configure.server CREDITS docs include pkg README.CLIENT rpm
[tjyang@fc6 trunk]$ history |grep commit
1159 svn commit -m "T.J. Yang's copy of hobbit"
1217 history |grep commit
1240 history |grep commit
[tjyang@fc6 trunk]$ svn commit -m "add pkg directory"
Sending trunk/README
Adding trunk/pkg
Adding trunk/pkg/tww
Transmitting file data .
Committed revision 5646.
[tjyang@fc6 trunk]$
Development Road Map
Henrik, Feb 9 2009
On February 9, Henrik posted the following roadmap to the list. I
haven't heard much lately so I don't know if it has changed.
Version 4.4:
SNMP support for data collection
Status updates based on data collected in the RRD files (this is really nice - essentially, *any* value you put into an RRD file can trigger a new or modified status in Xymon. So you could eg. change the status of your "http" test to go red, if the response time of a webpage exceeds 5 seconds).
Status "flap" handling, to catch statuses that change rapidly.
Version 4.5:
Support for communication between clients and Xymon to use compression and/or encryption.
Support for client authentication via SSL certificates (so you cannot spoof a client message).
Version 4.6:
Revised web interface - eliminate the need for webserver-based authentication, and provide more fine-grained authorization for the various Xymon components.
Per-user custom login pages, so the login will always show those systems that the user has responsibility for / is allowed to access.
Somewhere along the road I will also introduce a new "ping" test
daemon - I am getting to the point where ping'ing all hosts take
longer than 5 minutes (I have a lot of hosts). So something needs
to be done, and I think I know how to do it.
Changes
Todos
Tasks that most team member agree to implement.
Design Document
Hobbit Design Document
Wish Lists
Test Suite for software quality assurance.
Migrate all the bb modules from deadcat.net to hobbit.
SLA Report built in.
Better Theme support.
Provide encrypted communication pipe between hobbit server and hobbit client.
hobbit messages compression.
ipv6
4.2.x maintenance release.
Rewrite of the alerts module to work properly. ;) It's quite flawed at the moment.
Xymon volunteers Roles and Responsibility
This is a list of people offer their time and skill to Xymon community in following areas of R&R.
Project Admin
Has right as project admin on sourceforge.
Assign tickets to different persons listed below.
Grant new developer privilege on sourceforge.
Get people to work as a team with limited and un-paid resources.
Development
Understand Xymon source tree.
Do source code documentation.
Work on ticket from issue tracker.
Apply patches submitted from the Xymon community.
Implement new requested features
Documentation
Keep troff files updated with Xymon features.
maintain troff2html process.
Create a publish-grade manuals and process for Xymon using Latex.
use latex2troff tool to generate Xymon troff manpage sources.
Automate the document generation in "make" command process.
End User Support
Answer questions raised in xymon user email list.
Maintain Xymon FAQ.
Test out new Xymon features or verify a bug.
Module Development
Write new Xymon client external modules.
Write Xymon Server side external modules.
Maintain orphan Xymon modules.
Maintain Xymon module development guides.
Name Project Admin Development Documentation End User Support Module Development Henrik Størner Yes T.J. Yang Yes Yes Yes Jerald Sheets Yes Josh Luthman Malcolm Hunter Yes Yes Japheth J.C. Cleaver Steve Holmes Y Y ? Damien Martins (aka doctor madness) N Y Y N dubby Yes Flemming Yes Christoph Berg Yes Yes Vadim Pushkin Yes Martin Ward Yes Buchan Milne Yes Rich Smrcina Yes Kenneth Langford Yes Padraig Lennon David Baldwin Yes Ralph Mitchell Yes Yes Dummy Template Replace Here Admin Y/N Dev Y/N Doc Y/N User Support Y/N Module devel Y/N Olivier AUDRY Yes Yes Neil Franken Yes Yes Peter Toft
Packager Who is who
blingme: Mandriva
Christoph Berg (Myon): debian
Developers Who is who
Developers with write access
Henrik Stoerner: http://www.hswn.dk
Make Big Brother system monitor to be open again.
Rewrite Big Brother shell scrip part into C code to speed up the performance.
Amazon Wish List
Martin Ward
Rich Smrcina
Buchan Milne
T.J. Yang
hobbit wiki book project.
Autoconfiscate Hobbit.
Hobbit documentation project.
Will use latex to create hobbit manual.
Digitation of hobbit software build,package build and deployment process.
OpenSolaris VMWare appliance for Hobbit Development.
Using EXTJS 3.0 for hobbit menu system.
Developers
Vernon Everett
hobbit wiki and documentation.
Etienne GRIGNON (etienne.grignon@gmail.com )
BBWin: http://sourceforge.net/projects/bbwin
Francesco Duranti <fduranti@q8.it>
Ability to patch hobbit source code.
http://www.hswn.dk/hobbiton/2006/10/msg00080.html
TWW Inc.
Package the hobbit client and server using TWW toolsets.
List of Names contributed to this hobbit project
Manon Goo <manon@manon.de>
Alex Tang <altitude@cic.net>
Tim Hudson (tjh@cryptsoft.com)
Steve Reid <steve@edmweb.com>
Thomas Roessler <roessler@does-not-exist.org>
Wei Dai <weidai@eskimo.com>
Eric Young (eay@cryptsoft.com)
Charles Goyard <cg@fsck.Fr>
Marco Avvisano
Paul Backer
Olivier Beau
Adamets Bluejay
Brian Buchanan
Massimo Carnevali
Douwe Dijkstra
Francesco Duranti
Lars Ebeling
Tom Georgoulias
Laurent Grilli
Kevin Hanrahan
Asif Iqbal
Charles Jones
Thomas J Jones
Uwe Kirbach
Joshua Krause
Patrick Lin
Brian Lynch
Thomas Mattsson
Michael Fisher
Daniel J McDonald
Werner Michels
Christian Perrier
Jure Peternel
William Richardson
Torsten Richter
Chris Ricker
Tim Rotunda
Thomas Rucker
Mirko Saam
Thomas Schfer
Tom Schmidt
Eric Schwimmer
Bill Simaz
Gavin Stone-Tolcher
Jeff Stoner
David Stuffle
Christian Thibodeau
Rick Waegner
Rob Watson
Autoconfiscate Hobbit
This section describe the conversion of hobbit source tree into autotool control.
Why the autoconfiscation ?
To be more portable across OS platforms.
Plan for I18n and L10n.
To become true GNU software which require use of autotool.
Learn autotool
the autotools tutorial and read the pdf slides.
hand on testing on hello world example.
example of using autoscan.
Convert hobbit source tree
make sure your autotool sets has following version.
GNU Autoconf 2.61 (November 2006)
GNU Automake 1.10 (October 2006)
GNU Libtool 1.5.24 (June 2007)
GNU Gettext 0.17 (November 2007)
download the latest hobbit source tar ball.
run autoscan to get configure.scan and then modify it as configure.ac.
convert lib/Makefile demotool/Makefile ... etc into Makfile.am.
Fine tune configure.ac to take configuration options as configure options.
Support Linux and Solaris OS setting in configure.ac.
References
Great Autotool tutorials and links started here
Another tutorial
Autotool for Beginners
Xymon Documentation
Current
Henrik Stroner use troff to generate manual pages so that we have the RTFM type of documentation.
Also troff2html is used to create html page for web browser viewing.
Enhancements Proposals.
Use latex+dia+make+wiki to create publishing grade docs
Use Table of Conetent, index, references and Figures to describe Xymon related topic.
Generate Xymon User Guide.
Generate Xymon Developer Guide
Generate Xymon System Admin Guide.
Generate Xymon Slide for presentation purpose.
Use Wiki documentation content incubation.
Generate html.RTF and pdf for different purpose.
Request Development Team to use doxygen syntax for source code documentation.
MediaWiki to DocBook
use mvc to gain hobbit wiki source
convert mediawiki source to latex.
Man pages
Reuse content from existing hobbit documentation source
http://www.hswn.dk/hobbit/help/manpages/
Xymon test suite
Run through test cases to verify the code changes are ok.
Performance test scripts
Quality assurance test scripts
shell scripts
test script in build directory of hobbit-4.0.3 to make sure depended software are in build machine.
build/perl.sh
build/fping.sh
build/rrd.sh
build/ssl.sh
build/ldap.sh
build/pcre.sh
Test script by Perl
Test script by Python
Test script by DejaGNU
Dtrace probes in hobbit server
An example of putting dtrace probe int an application.
Packaging
Hobbit Client for OpenSolaris IPS format
Features of This hobbit client
This hobbit client will use a local account and group to avoid NIS and NFS dependency.
It will use SMF to start/top hobbit client.
It will use sudo or Solaris 10's ACL to achieve reading restricted information off OpenSolaris.
hobbit-client-serverconf is simple version of hobbit client without local messages processing.
hobbit-client-local will do some processing filtering, it need more depended software.
it use /opt/hobbitclient42 as installation path.
svcadm disable/enable network:/hobbit-client-serverconf
OpenSolaris info
OpenSolaris 2008.05
-bash-3.2# uname -a
SunOS opensolaris 5.11 snv_86 i86pc i386 i86pc
-bash-3.2# cat /etc/release
Open Solaris 2008.05 snv_86_rc2a X86
Copyright 2008 Sun Microsystems, Inc. All Rights Reserved.
Use is subject to license terms.
Assembled 23 April 2008
-bash-3.2#
Installed Sun and SUNW gcc-3.4.3 compilers.
if not installed run "pkg install sunstudioexpress" and "pkg install SUNWgcc".
-bash-3.2# pkg info sunstudioexpress SUNWgcc
Name: sunstudioexpress
Summary: Sun Studio Express - C, C++, & Fortran compilers and Tools
State: Installed
Authority: opensolaris.org (preferred)
Version: 0.2008.5
Build Release: 5.11
Branch: 0.86
Packaging Date: Wed Apr 30 21:10:32 2008
Size: 566.2 MB
FMRI: pkg:/sunstudioexpress@0.2008.5,5.11-0.86:20080430T211032Z
Name: SUNWgcc
Summary: gcc - The GNU C compiler
State: Installed
Authority: opensolaris.org (preferred)
Version: 3.4.3
Build Release: 5.11
Branch: 0.86
Packaging Date: Sat Apr 26 18:22:21 2008
Size: 60.4 MB
FMRI: pkg:/SUNWgcc@3.4.3,5.11-0.86:20080426T182221Z
-bash-3.2#
Using shell script to automate package building
RPM
[root] cat build/makerpm.sh
#!/bin/sh
REL=$1
if [ "$REL" = "" ]; then
echo "Error - missing release number"
exit 1
fi
cd ~/hobbit
rm -rf rpmbuild
# Setup a temp. rpm build directory.
mkdir -p rpmbuild/RPMS rpmbuild/RPMS/i386 rpmbuild/BUILD rpmbuild/SPECS rpmbuild/SRPMS rpmbuild/SOURCES
cat >rpmbuild/.rpmmacros <<EOF1
# Default macros for my enviroment.
%_topdir `pwd`/rpmbuild
%_tmppath /tmp
EOF1
cat >rpmbuild/.rpmrc <<EOF2
# rpmrc
buildarchtranslate: i386: i386
buildarchtranslate: i486: i386
buildarchtranslate: i586: i386
buildarchtranslate: i686: i386
EOF2
cat rpm/hobbit.spec | sed -e "s/@VER@/$REL/g" >rpmbuild/SPECS/hobbit.spec
cp rpm/hobbit-init.d rpmbuild/SOURCES/
cp rpm/hobbit.logrotate rpmbuild/SOURCES/
mkdir -p rpmbuild/hobbit-$REL
for f in bbdisplay bbnet bbpatches bbproxy build common docs hobbitd include lib scripts
do
find $f/ | grep -v RCS | cpio -pdvmu ~/hobbit/rpmbuild/hobbit-$REL/
done
cp -p Changes configure COPYING CREDITS README ~/hobbit/rpmbuild/hobbit-$REL/
find ~/hobbit/rpmbuild/hobbit-$REL -type d|xargs chmod 755
cd rpmbuild
tar zcf SOURCES/hobbit-$REL.tar.gz hobbit-$REL
rm -rf hobbit-$REL
HOME=`pwd` rpmbuild -ba --clean SPECS/hobbit.spec
rpm --addsign RPMS/i?86/hobbit-$REL-*.i?86.rpm
mv RPMS/i?86/hobbit-$REL-*.i?86.rpm SRPMS/hobbit-$REL-*.src.rpm ../rpm/pkg/
[root]
Using CPAM tools to automate package building
How to participate the hobbit development
subscribe to hobbit mailing list
create an account on en.wikibooks.org to participate in hobbit documentation effort.
learn from http://en.wikibooks.org/wiki/CPAM_with_TWW to participate in hobbit automated cross-platform software packaging effort.
Setup your development environment
On OpenSolaris x86
Using prebuilt OpenSoalris VMWare Image
Download OpenSolaris VMWare Image from here(TBA).
Install VMWare player 3.0 from here(TBA).
Using VirtualBox OpenSolaris Image
On Solaris 10 Intel
host info
bash-3.00# which cvs
/opt/csw/bin/cvs
bash-3.00# uname -a
SunOS unknown 5.10 Generic i86pc i386 i86pc
bash-3.00# which gcc
/opt/csw/gcc3/bin/gcc
bash-3.00# which gmake
/opt/csw/bin/gmake
bash-3.00#
On RedHat Linux
Setup your TWW developement
download TWW tools onto your system
compile hobbit*.[sb|pb].
checkout source code from sourceforge.net
Read the source codes
Feedback to Hobbit
include your fix,patch, modules addition to sourceforge.net
Hobbit Functional diagrams
Hobbit server
So the core design looks like this:
Network tests --\
\
TCP:1984 \ IPC
Clients ----------> hobbitd --------> hobbitd_channel ---> worker module
/ Sh. mem. stdin
/
Custom tests ---/
Windows Hobbit client
BB Win
Hobbit Modules Development
Developing Hobbit by Existing Internet Development Environment
Custom Monitoring Scripts for Hobbit
System Monitoring with Hobbit/HOWTO/Custom Monitoring Scripts for Hobbit
http://www.hswn.dk/hobbit/help/hobbit-tips.html#scripts
Developing Hobbit by CPAM/TWW Development Environment
Why use CPAM/TWW tool ?
Pros
Hobbit server and client need to be cross-platform thus the need of CPAM/TWW.
Like Emacs editor, it can will be run everywhere without license. TWW tools is GPL opensource so it can be ported to any OS.
A structural and automated approach to deal with packages creation and management.
Cons
Another learning curve need to climb.
Changing people's development habit is hard.
Supported OS
Solaris Sparc
RH AS 3.0
HP-UX 11.11
Hobbit package sources
Hobbit client on MS windows Overview
bbwin (Xymon client) is implemented in c++. It requires opensource software like boost c++ libary and tinyXML.
The packaging tool it used is Microsoft's opensource packaging tool - WiXto do the Win32 packaging.
The detals building instruction is build.txt on bbwin project site.
You have two ways to build BBWin.msi,
Use Microsoft's make: nmake
Use "Build Soultion" in VS2008.
Following is a procedure to create a Windows XP development box so you can create your own BBWin.msi.
Prepare your Xymon win32 build environment
Install hhc.exe,it is used to compile html doc into windows chm help file.
add "C:\Program Files\HTML Help Workshop" into PATH so hhc.exe is accessible.
Install Visual Studio 2008 Standard or Professional Edition.
Make sure your cmd.exe has following PATH name addition. echo %PATH% %INCLUDE% %LIB% in your DOS prompt.
PATH
"LIB=C:\Program Files\Microsoft Platform SDK\Lib\.;C:\Program Files\Microsoft Visual Studio 8\VC\LIB;"
INCLUDE
INCLUDE=C:\Program Files\Microsoft Platform SDK\Include\.;
C:\Program Files\Microsoft Platform SDK\Include\atl;C:\Program Files\Microsoft Visual Studio 8\VC\include
Install a svn client for your windows machine.
tortoise svn
Windows Server 2003 SP1 Platform SDK Web Install: It is use to have the complete sdk to develop programs on Microsoft OS. Remeber to install all options (include 64 bit and 32 bit) to avoid "atlthunk.lib not found" issue.
install visual service pack 1:
MSDN blog about VS2008 and SDK
WiX opensource packaging tool from Microsoft: this is use to turn the compiled binary into MS MSI package format.
Boost C++ library:These powerful C++ libraries are used for some agents and will be certainly used in the BBWin core service in the future.
Download the pre-compiled 1.35 one for VS2008 and install it under C:\boost directory.
TinyXML: BBWin used the excellent TinyXML library for the configuration loading XML. You do not need to download and install it. TinyXML sources are included in BBWin sources.
Prepare your source code editors:
notepade++:
XEmacs for win32:
checkout bbwin src.
Using command "svn co https://bbwin.svn.sourceforge.net/svnroot/bbwin bbwin"
Change the Makefile code for C:\boost installation.
Modify Makefile to point INCLUDE to C:\boost and LIB to include C:\boost\lib\*.lib
Modify C/C++ include c:\boost and Linker to include c:\boost\lib\*.
Optional software installation
install cygwin to have a strong unix enviroment on your windows box. So you can run command like following to clean up *.obj file that current makefile can't do.
Clean up Release directory by Deleting Setup/*.msi
$ rm Setup/*
$ rm Release/*
Build the bbwin using command line approach
BBWin.msi creation process is automated in "C:\BBWin\trunk\Setup\Makefile".
This makefile will be called from "C:\BBWin\trunk\Makefile"
Make sure your nmake command is available.
C:\bbwin-src\trunk>nmake -help
Microsoft (R) Program Maintenance Utility Version 8.00.50727.762
Copyright (C) Microsoft Corporation. All rights reserved.
Usage: NMAKE @commandfile
NMAKE [options] [/f makefile] [/x stderrfile] [macrodefs] [targets]
Options:
/A Build all evaluated targets
/B Build if time stamps are equal
/C Suppress output messages
/D Display build information
/E Override env-var macros
/ERRORREPORT:{NONE|PROMPT|QUEUE|SEND} Report errors to Microsoft
/G Display !include filenames
/HELP Display brief usage message
/I Ignore exit codes from commands
/K Build unrelated targets on error
/N Display commands but do not execute
/NOLOGO Suppress copyright message
/P Display NMAKE information
/Q Check time stamps but do not build
/R Ignore predefined rules/macros
/S Suppress executed-commands display
/T Change time stamps but do not build
/U Dump inline files
/Y Disable batch-mode
/? Display brief usage message
C:\bbwin-src\trunk>
cd to c:\bbwin top source directory.
type "nmake" to kick off the build.
Compilation error
atlbase.h not found
Error message
C:\bbwin\trunk\Core\Agents\common>nmake
Microsoft (R) Program Maintenance Utility Version 9.00.30729.01
Copyright (C) Microsoft Corporation. All rights reserved.
cl -Zi -Od -DDEBUG -c -DCRTAPI1=_cdecl -DCRTAPI2=_cdecl -nologo -GS -D_X
86_=1 -DWIN32 -D_WIN32 -W3 -D_WINNT -D_WIN32_WINNT=0x0500 -DNTDDI_VERSION=0x050
00000 -D_WIN32_IE=0x0500 -DWINVER=0x0500 /EHsc /I ../.. /I C:\boost\include\boos
t-1_33_1 -D_MT -MTd SystemCounters.cpp
SystemCounters.cpp
SystemCounters.cpp(20) : fatal error C1083: Cannot open include file: 'atlbase.h
': No such file or directory
NMAKE : fatal error U1077: '"C:\Program Files\Microsoft Visual Studio 9.0\VC\BIN
\cl.EXE"' : return code '0x2'
Stop.
C:\bbwin\trunk\Core\Agents\common>
make sure you have following directory and file, if not then you need to use VS non-Express version.
C:\Program Files\Microsoft Visual Studio 8\VC\atlmfc\include\atlbase.h
Possible fix
Temporary Fix for following
Goal is to get rid of " -D_MT -MTd" when using cl MS compiler.
Run this command in cygwin shell on your codebase, "find . -type f -name Makefile -exec perl -pi -e 's!cvarsmt!conlibsdll!' {} \;" , to replace cvarsmt with conlibsdll. I don't know the exact impact of not building code with multihreading library.
* LINK : warning LNK4098: defaultlib 'LIBCMT' conflicts with use of other libs; use /NODEFAULTLIB:library
*** C:\bbwin09\trunk\Core\Agents\procs *** "C:\Program Files\Microsoft Visual Studio 8\VC\BIN\nmake.exe" -nologo /L
link /DLL procs.obj procs.res -out:procs.dll /LIBPATH:C:\boost\lib libboost_date_time-vc80-mt-s.lib
Microsoft (R) Incremental Linker Version 8.00.50727.762
Copyright (C) Microsoft Corporation. All rights reserved.
LIBCMT.lib(invarg.obj) : error LNK2005: __initp_misc_invarg already defined in LIBCMTD.lib(invarg.obj)
LIBCMT.lib(invarg.obj) : error LNK2005: __invoke_watson already defined in LIBCMTD.lib(invarg.obj)
LIBCMT.lib(invarg.obj) : error LNK2005: __set_invalid_parameter_handler already defined in LIBCMTD.lib(invarg.obj)
LIBCMT.lib(invarg.obj) : error LNK2005: __get_invalid_parameter_handler already defined in LIBCMTD.lib(invarg.obj)
LIBCMT.lib(invarg.obj) : error LNK2005: "void __cdecl _invoke_watson(unsigned short const *,unsigned short const *,unsigned short const *,unsigned int,unsigned int)" (?_invoke_watson@@YAXPBG00II@Z) already defined in LIBCMTD.lib(invarg.obj)
LIBCMT.lib(invarg.obj) : error LNK2005: __invalid_parameter already defined in LIBCMTD.lib(invarg.obj)
LIBCMT.lib(invarg.obj) : error LNK2005: "void __cdecl _invalid_parameter(unsigned short const *,unsigned short const *,unsigned short const *,unsigned int,unsigned int)" (?_invalid_parameter@@YAXPBG00II@Z) already defined in LIBCMTD.lib(invarg.obj)
LIBCMT.lib(invarg.obj) : error LNK2005: ___pInvalidArgHandler already defined in LIBCMTD.lib(invarg.obj)
Creating library procs.lib and object procs.exp
LINK : warning LNK4098: defaultlib 'LIBCMT' conflicts with use of other libs; use /NODEFAULTLIB:library
procs.dll : fatal error LNK1169: one or more multiply defined symbols found
NMAKE : fatal error U1077: '"C:\Program Files\Microsoft Visual Studio 8\VC\BIN\link.EXE"' : return code '0x491'
Stop.
*** C:\bbwin09\trunk\Core\Agents\sample *** "C:\Program Files\Microsoft Visual Studio 8\VC\BIN\nmake.exe" -nologo /L
*** C:\bbwin09\trunk\Core\Agents\bbwinupdate *** "C:\Program Files\Microsoft Visual Studio 8\VC\BIN\nmake.exe" -nologo /L
C:\bbwin09\trunk\Core>
http://msdn.microsoft.com/en-us/library/Aa267384
Possible fix with similar issue.
vc6 to vc8.
Try to link with "/NODEFAULTLIB:library".
C:\bbwin09\trunk\Core\Agents\procs>nmake clean
nmake clean
Microsoft (R) Program Maintenance Utility Version 8.00.50727.762
Copyright (C) Microsoft Corporation. All rights reserved.
erase /Q /S procs.res procs.obj procs.dll procs.exp procs.lib procs.obj
Deleted file - C:\bbwin09\trunk\Core\Agents\procs\procs.res
Deleted file - C:\bbwin09\trunk\Core\Agents\procs\procs.obj
Deleted file - C:\bbwin09\trunk\Core\Agents\procs\procs.exp
Deleted file - C:\bbwin09\trunk\Core\Agents\procs\procs.lib
C:\bbwin09\trunk\Core\Agents\procs>nmake
nmake
Microsoft (R) Program Maintenance Utility Version 8.00.50727.762
Copyright (C) Microsoft Corporation. All rights reserved.
cl -Zi -Od -DDEBUG -c -DCRTAPI1=_cdecl -DCRTAPI2=_cdecl -nologo -GS -D_X86_=1 -DWIN32 -D_WIN32 -W3 -D_WINNT -D_WIN32_WINNT=0x0500 -D_WIN32_IE=0x0500 -DWINVER=0x0500 /EHsc /I ../.. /I ../common /I C:\boost\include\boost-1_33_1 -D_MT -MTd procs.cpp
procs.cpp
C:\boost\include\boost-1_33_1\boost/date_time/c_time.hpp(68) : warning C4996: 'localtime': This function or variable may be unsafe. Consider using localtime_s instead. To disable deprecation, use _CRT_SECURE_NO_WARNINGS. See online help for details.
C:\Program Files\Microsoft Visual Studio 8\VC\include\time.inl(114) : see declaration of 'localtime'
C:\boost\include\boost-1_33_1\boost/date_time/c_time.hpp(75) : warning C4996: 'gmtime': This function or variable may be unsafe. Consider using gmtime_s instead. To disable deprecation, use _CRT_SECURE_NO_WARNINGS. See online help for details.
C:\Program Files\Microsoft Visual Studio 8\VC\include\time.inl(101) : see declaration of 'gmtime'
C:\boost\include\boost-1_33_1\boost/utility/enable_if.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss
C:\boost\include\boost-1_33_1\boost/lexical_cast.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss
C:\boost\include\boost-1_33_1\boost/utility/enable_if.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss
C:\boost\include\boost-1_33_1\boost/type_traits/is_base_and_derived.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss
C:\boost\include\boost-1_33_1\boost/lexical_cast.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss
C:\boost\include\boost-1_33_1\boost/tokenizer.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss
C:\boost\include\boost-1_33_1\boost/lexical_cast.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss
C:\boost\include\boost-1_33_1\boost/lexical_cast.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss
C:\boost\include\boost-1_33_1\boost/tokenizer.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss
C:\boost\include\boost-1_33_1\boost/lexical_cast.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss
C:\boost\include\boost-1_33_1\boost/format/internals.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss
C:\boost\include\boost-1_33_1\boost/format/alt_sstream_impl.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss
C:\boost\include\boost-1_33_1\boost/format/internals.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss
C:\boost\include\boost-1_33_1\boost/format/alt_sstream_impl.hpp(252) : warning C4996: 'std::char_traits<char>::copy': Function call with parameters that may be unsafe - this call relies on the caller to check that the passed values are correct. To disable this warning, use -D_SCL_SECURE_NO_WARNINGS. See documentation on how to use Visual C++ 'Checked Iterators'
C:\Program Files\Microsoft Visual Studio 8\VC\include\iosfwd(446) : see declaration of 'std::char_traits<char>::copy'
C:\boost\include\boost-1_33_1\boost/format/alt_sstream_impl.hpp(223) : while compiling class template member function 'int boost::io::basic_altstringbuf<Ch,Tr,Alloc>::overflow(int)'
with
[
Ch=char,
Tr=std::char_traits<char>,
Alloc=std::allocator<char>
]
C:\boost\include\boost-1_33_1\boost/format/format_class.hpp(136) : see reference to class template instantiation 'boost::io::basic_altstringbuf<Ch,Tr,Alloc>' being compiled
with
[
Ch=char,
Tr=std::char_traits<char>,
Alloc=std::allocator<char>
]
procs.cpp(235) : see reference to class template instantiation 'boost::basic_format<Ch>' being compiled
with
[
Ch=char
]
Rc /r -DWIN32 -D_WIN32 -DWINVER=0x0500 -DDEBUG -D_DEBUG /fo procs.res procs.rc
link /NODEFAULTLIB:library procs.obj procs.res -out:procs.dll /LIBPATH:C:\boost\lib libboost_date_time-vc80-mt-s.lib
Microsoft (R) Incremental Linker Version 8.00.50727.762
Copyright (C) Microsoft Corporation. All rights reserved.
LIBCMT.lib(invarg.obj) : error LNK2005: __initp_misc_invarg already defined in LIBCMTD.lib(invarg.obj)
LIBCMT.lib(invarg.obj) : error LNK2005: __invoke_watson already defined in LIBCMTD.lib(invarg.obj)
LIBCMT.lib(invarg.obj) : error LNK2005: __set_invalid_parameter_handler already defined in LIBCMTD.lib(invarg.obj)
LIBCMT.lib(invarg.obj) : error LNK2005: __get_invalid_parameter_handler already defined in LIBCMTD.lib(invarg.obj)
LIBCMT.lib(invarg.obj) : error LNK2005: "void __cdecl _invoke_watson(unsigned short const *,unsigned short const *,unsigned short const *,unsigned int,unsigned int)" (?_invoke_watson@@YAXPBG00II@Z) already defined in LIBCMTD.lib(invarg.obj)
LIBCMT.lib(invarg.obj) : error LNK2005: __invalid_parameter already defined in LIBCMTD.lib(invarg.obj)
LIBCMT.lib(invarg.obj) : error LNK2005: "void __cdecl _invalid_parameter(unsigned short const *,unsigned short const *,unsigned short const *,unsigned int,unsigned int)" (?_invalid_parameter@@YAXPBG00II@Z) already defined in LIBCMTD.lib(invarg.obj)
LIBCMT.lib(invarg.obj) : error LNK2005: ___pInvalidArgHandler already defined in LIBCMTD.lib(invarg.obj)
Creating library procs.lib and object procs.exp
LINK : warning LNK4098: defaultlib 'LIBCMT' conflicts with use of other libs; use /NODEFAULTLIB:library
LIBCMTD.lib(crt0.obj) : error LNK2019: unresolved external symbol _main referenced in function ___tmainCRTStartup
procs.dll : fatal error LNK1120: 1 unresolved externals
NMAKE : fatal error U1077: '"C:\Program Files\Microsoft Visual Studio 8\VC\BIN\link.EXE"' : return code '0x460'
Stop.
C:\bbwin09\trunk\Core\Agents\procs>
build the bbwin using GUI approach
check out the source code
open up bbwin.sln
follow text will turn into wiki procedure above.
Build file for BBWin
2 ==============================================================
3
4 This file explains you how to build BBWin from the sources.
5
6
7 Getting the last sources
8 ========================
9
10 BBWin is developed in C++ (the Standard Template Library and the Standard C++ Library
11 are used)
12 The source of BBWin are available from the sourceforge subversion
13 repository for the BBWin projects :
14 http://svn.sourceforge.net/viewcvs.cgi/bbwin/
15
16
17 Install the tools
18 =================
19
20 BBWin has been developed thanks to many tools. You should install them to
21 build BBWin easily without troubles.
22
23 Windows Platform SDK 2003 : it is used for the development environment.
24 It is use to have the complete sdk to develop programs on Microsoft OS.
25 You can download it for free from microsoft website :
26 http://www.microsoft.com/downloads/details.aspx?FamilyId=A55B6B43-E24F-4EA3-A93E-40C0EC4F68E5&displaylang=en
27 You will need 1 gb of free space if you install every thing :)
28 BBWin Makefiles are using the nmake tool and Makefile templates from the SDK.
29 This SDK is very important for anyone who would like to start developing under Windows.
30
31 Visual C++ Toolkit : it is the compiler used to build the bbwin release
32 It is the original compiler from Visual Studio 2003 Professional (Code optimisation is included)
33 You can download it for free from the Microsoft website :
34 http://msdn.microsoft.com/visualc/vctoolkit2003/
35
36 Wix Toolkit : this package is used to build the BBWin MSI installer
37 You should install it and have the bin directory in your current path
38 http://sourceforge.net/projects/wix/
39
40 TinyXML : BBWin used the excellent TinyXML library for the configuration loading XML.
41 You do not need to install it. TinyXML sources are included in BBWin sources.
42
43 Boost Lib : These powerful C++ libraries are used for some agents and will be
44 certainly used in the BBWin core service in the future.
45 You should get the boost C++ from the website :
46 http://www.boost.org/
47 Build it in the directory C:\boost so you won't have to change BBWin Makefiles.
48 If you want to build BBWin with Visual C++ Express 2005, please read the following page :
49 http://www.boost.org/tools/build/v1/vc-8_0-tools.html
50
51
52 I recommand you the Notepad++ editor if you are looking for a nice free code editor.
53 You can download it from :
54 http://notepad-plus.sourceforge.net
55
56
57
58 Building the BBWin with Visual C++ Express 2005
59 ===============================================
60
61 Open the BBWin.sln file at the top directory of the project
62 First, you should prepare your Visual C++ configuration by adding
63 in the default bin, include and lib directories the different directories from :
64
65 - the platform SDK
66 - the boost libraries
67
68 Then just build the solution.
69
70
71 Building the BBWin with Visual C++ ToolKit 2003
72 ===============================================
73
74 Open a Platform SDK Build command line environment (installed with the Platform SDK)
75 Go the top directory of the BBWin source tree
76 Type nmake
77 Go get a cup of coffee
78 It's ready !
79
80 If you get errors, it may be due to some errors in your include or lib path.
81 Make sure the environment variables %Lib%; %Path% and %Include% are correctly
82 configured. You may need to add some directories.
83
84 Building process order
85 ======================
86
87 1) BBWin core service
88 2) Agents
89 3) Externals (needing compilation)
90 4) Setup MSI
91
Example of using nmake to create a BBwin.msi
C:\tmp\test\trunk\Setup>nmake clean
Microsoft (R) Program Maintenance Utility Version 8.00.50727.42
Copyright (C) Microsoft Corporation. All rights reserved.
erase /q /s BBWin.dll BBWin.exp UpgradeConfiguration.obj BBWin.res BBWin
.wixobj BBWin.msi BBWin.lib
Deleted file - C:\tmp\test\trunk\Setup\BBWin.wixobj
Deleted file - C:\tmp\test\trunk\Setup\BBWin.msi
C:\tmp\test\trunk\Setup>nmake
Microsoft (R) Program Maintenance Utility Version 8.00.50727.42
Copyright (C) Microsoft Corporation. All rights reserved.
candle /nologo BBWin.wxs
BBWin.wxs
light /nologo BBWin.wixobj
C:\tmp\test\trunk\Setup>
bbwin 0.9 package source
Hobbit server software build source
How to use hobbit-4.0.3.sb build source ?
hobbit-4.0.3.sb is an XML file contain the detail exact steps to build hobbit-4.03. into binary code for different OS. It need to be run against "sb" tool.
TBA.
The source : hobbit-4.0.3.sb
[root] cat hobbit-4.0.3.sb
<?xml version="1.0"?>
<programs>
<program name="hobbit" version="4.0.3" revision="1">
<module name="default">
<build-name>hobbit-4.0.3</build-name>
<install-name>hobbit</install-name>
<syntaxhighlights>
<syntaxhighlight path="src/hobbit-4.0.3.tar.gz" />
</sources>
<dependencies>
<depend var="fping">fping24</depend>
<depend var="APACHESS">apacheS2048</depend>
<depend var="RRDTOOL">rrdtool10</depend>
<depend var="PCRE">libpcre44</depend>
<depend var="OPENSSL">libopenssl097</depend>
<depend var="OPENLDAP">openldap2127</depend>
</dependencies>
<!--
######################################
# Platform specific configuration
######################################
-->
<configure>
<![CDATA[
case "${SB_SYSTYPE}" in
*-hpux11.11)
;;
*-hpux10.20)
;;
*-linux*)
;;
*-solaris2*)
;;
esac
set -x
rm -f Makefile
TARGET=hobbit \
ENABLESSL=y \
ENABLELDAP=y \
ENABLELDAPSSL=y \
BBUSER=hobbit \
BBTOPDIR=/opt/TWWfsw/hobbit \
BBVAR=/var/opt/TWWfsw/hobbit/data \
BBHOSTURL=/hobbit \
CGIDIR=/etc/opt/TWWfsw/apacheS2048/cgi-bin \
BBCGIURL=/hobbit-cgi \
SECURECGIDIR=/etc/opt/TWWfsw/apacheS2048/cgi-secure \
SECUREBBCGIURL=/hobbit-seccgi \
HTTPDGID=il02w-web \
BBLOGDIR=/var/opt/TWWfsw/hobbit/log/hobbit \
BBHOSTNAME=localhost \
BBHOSTIP=127.0.0.1 \
MANROOT=/opt/TWWfsw/hobbit/man \
BARS=all \
USENEWHIST=y \
PIXELCOUNT=960 \
MAKE=/opt/TWWfsw/bin/gmake \
INSTALLBINDIR=/opt/TWWfsw/hobbit/server/bin \
INSTALLETCDIR=/opt/TWWfsw/hobbit/server/etc \
INSTALLWEBDIR=/opt/TWWfsw/hobbit/web \
INSTALLEXTDIR=/opt/TWWfsw/hobbit/server \
INSTALLTMPDIR=/var/opt/TWWfsw/hobbit/tmp \
INSTALLWWWDIR=/opt/TWWfsw/hobbit/server/www ./configure \
--rrdinclude /opt/TWWfsw/rrdtool10/include \
--rrdlib /opt/TWWfsw/rrdtool10/lib \
--pcreinclude /opt/TWWfsw/libpcre44/include \
--pcrelib /opt/TWWfsw/libpcre44/lib \
--sslinclude /opt/TWWfsw/libopenssl097/include \
--ssllib /opt/TWWfsw/libopenssl097/lib \
--ldapinclude /opt/TWWfsw/openldap2127/include \
--ldaplib /opt/TWWfsw/openldap2127/lib \
--fping /opt/TWWfsw/fping24/sbin/fping
]]>
</configure>
<!--
######################################
# Now build (compile) the software
######################################
-->
<build>
<![CDATA[
case "${SB_SYSTYPE}" in
*-hpux11.11)
gmake
;;
*-hpux10.20)
;;
*-linux*)
gmake
;;
*-solaris2.[689])
gmake
;;
esac
]]>
</build>
<install>
<![CDATA[
########################################################
# building hobbit on different OS
########################################################
case "${SB_SYSTYPE}" in
*-hpux11.11)
gmake install
;;
*-hpux10.20)
;;
*-linux*)
gmake install
;;
*-solaris2.[689])
LD_LIBRARY_PATH=/opt/TWWfsw/libopenssl097/lib
export LD_LIBRARY_PATH
gmake install
;;
esac
## create man directory for TWW
#ln -s /opt/TWWfsw/hobbit/server/bin /opt/TWWfsw/hobbit/bin
#mkdir -p /opt/TWWfsw/hobbit/man
#cp -rp /opt/TWWfsw/hobbit/server/www/help/manpages/* /opt/TWWfsw/hobbit/man
#
]]>
</install>
<uninstall>
<![CDATA[
set -x
rm -rf /opt/TWWfsw/hobbit
rm -rf /etc/opt/TWWfsw/apacheS2048/cgi-secure
rm -rf /etc/opt/TWWfsw/apacheS2048/cgi-bin/bb-*
rm -rf /etc/opt/TWWfsw/apacheS2048/cgi-bin/hobbit*
rm -rf /var/opt/TWWfsw/hobbit
]]>
</uninstall>
</module>
<notes>
<note type="installation">
<para>
This sb file is to digitalize the hobbit software build process for different OS.
Original: 05/26/2005 T.J.Yang tj_yang at hotmail do com
</para>
</note>
</notes>
<changelog>
</changelog>
</program>
</programs>
[root]
Hobbit server package build source
hobbit-4.0.3.pb
[root] cat hobbit-4.0.3.pb
<?xml version="1.0"?>
<packages>
<package name="hobbit" version="4.0.3" revision="1">
<package-manager name="depot">
<title>hobbit</title>
<vendor>GPL</vendor>
<description >
</description>
<install-name>hobbit</install-name>
<pkgname-base>TWWhobbit</pkgname-base>
<version>4.0.3</version>
<revision>1</revision>
<subpkg type="runtime">
</subpkg>
</package-manager>
<package-manager name="rpm4">
<category>System Environment/Daemons</category>
<title>Hobbit System Monitoring Tool</title>
<vendor>GNU</vendor>
<description>
Hobbit System Monitoring tool. An open-source version of Big Brother.
</description>
<install-name>hobbit</install-name>
<pkgname-base>TWWhobbit</pkgname-base>
<init name="/etc/init.d/TWWhobbit" path="pkg/hobbit-init-linux" />
<init link-src="/etc/rc2.d/S661hobbit"
link-dest="/etc/init.d/TWWhobbit"/>
<init link-src="/etc/rc1.d/K269hobbit"
link-dest="/etc/init.d/TWWhobbit"/>
<config>/etc/init.d/TWWhobbit</config>
<version>4.0.3</version>
<revision>1</revision>
<subpkg type="runtime">
<depend pkgname-base="TWWperl561" title="perl 5.6.1" subpkg="runtime">v>=5.6.1 r>=1</depend>
<depend pkgname-base="TWWrrdtool10" title="Round Robin Database" subpkg="runtime">v>=1.0.42</depend>
<depend pkgname-base="TWWrrdtool10" title="Round Robin Database" subpkg="man">v>=1.0.42</depend>
</subpkg>
<subpkg type="conf">
<depend pkgname-base="TWWhobbit" title="Client: Big Brother System Monitoring Tool" subpkg="runtime">v>=4.0.3</depend>
<postinstall path="pkg/postinstall-linux" />
<preremove path="pkg/preremove-linux" />
<postremove path="pkg/postremove-linux" />
</subpkg>
</package-manager>
</package>
</packages>
[root]
Hobbit Required Packages
fping
apache web server
rrdtool
pcre
openssl
openldap
following is the listing of exact version to build hobbit-4.0.3
<dependencies>
<depend var="fping">fping24</depend>
<depend var="APACHESS">apacheS2048</depend>
<depend var="RRDTOOL">rrdtool10</depend>
<depend var="PCRE">libpcre44</depend>
<depend var="OPENSSL">libopenssl097</depend>
<depend var="OPENLDAP">openldap2127</depend>
</dependencies>
Following diagram list out all the hobbit depended software by GraphViz
TBA.
Package build automation
The Makefile to automate the whole process
Create a firefox search engine plugin for hobbit server
References: http://mycroft.mozdev.org/deepdocs/deepdocs.html
Using relational DBs with Xymon Server
The default database back end of Xymon is RRD(Roun-Robin Database).
Database
RRD
SQLite3
Almost as fast as C fopen function code.
No server process, data are store in plain files.
Just like another rrd file that can be rsynced over to your standby xymon server.
MySql
light weight DB.
Oracle
LDAP
XML flat file
Benefits of using relation DBs
Inventory Monitoring
Store a machine's asset information
Serial Number
OS type
Computer Maker
Leased/owned
Trigger an alert if leasing is expiring soon.
Display pie chart of OS type,Makers ... etc.
bb-hosts generation
bb-hosts files got generated from host database table.
MVC Implementation
Mysql + PHP + EXTJS
Catalyst/SQLite
Bill of Materials
Catalyst Book 1
perl-5.10.0
Fedora 11
Address Book Example in Book 1.
SQLite3
Catalyst::Runtime,Catalyst::Plugins::*,Catalyst::Devel.
Sql files to create Asset schema.
Procedures
Use catalyst.pl to initiate your MVC project with sample templates.
[tjyang@t-fedora11 test]$ catalyst.pl xymonasset
created "xymonasset"
created "xymonasset/script"
created "xymonasset/lib"
created "xymonasset/root"
created "xymonasset/root/static"
created "xymonasset/root/static/images"
created "xymonasset/t"
created "xymonasset/lib/xymonasset"
created "xymonasset/lib/xymonasset/Model"
created "xymonasset/lib/xymonasset/View"
created "xymonasset/lib/xymonasset/Controller"
created "xymonasset/xymonasset.conf"
created "xymonasset/lib/xymonasset.pm"
created "xymonasset/lib/xymonasset/Controller/Root.pm"
created "xymonasset/README"
created "xymonasset/Changes"
created "xymonasset/t/01app.t"
created "xymonasset/t/02pod.t"
created "xymonasset/t/03podcoverage.t"
created "xymonasset/root/static/images/catalyst_logo.png"
created "xymonasset/root/static/images/btn_120x50_built.png"
created "xymonasset/root/static/images/btn_120x50_built_shadow.png"
created "xymonasset/root/static/images/btn_120x50_powered.png"
created "xymonasset/root/static/images/btn_120x50_powered_shadow.png"
created "xymonasset/root/static/images/btn_88x31_built.png"
created "xymonasset/root/static/images/btn_88x31_built_shadow.png"
created "xymonasset/root/static/images/btn_88x31_powered.png"
created "xymonasset/root/static/images/btn_88x31_powered_shadow.png"
created "xymonasset/root/favicon.ico"
created "xymonasset/Makefile.PL"
created "xymonasset/script/xymonasset_cgi.pl"
created "xymonasset/script/xymonasset_fastcgi.pl"
created "xymonasset/script/xymonasset_server.pl"
created "xymonasset/script/xymonasset_test.pl"
created "xymonasset/script/xymonasset_create.pl"
[tjyang@t-fedora11 test]$ catalyst.pl
perl Makefile.PL
[tjyang@t-fedora11 xymonasset]$ perl Makefile.PL
include /var/www/html/test/xymonasset/inc/Module/Install.pm
include inc/Module/Install/Metadata.pm
include inc/Module/Install/Base.pm
Cannot determine perl version info from lib/xymonasset.pm
include inc/Module/Install/Catalyst.pm
*** Module::Install::Catalyst
include inc/Module/Install/Makefile.pm
Please run "make catalyst_par" to create the PAR package!
*** Module::Install::Catalyst finished.
include inc/Module/Install/Scripts.pm
include inc/Module/Install/AutoInstall.pm
include inc/Module/Install/Include.pm
include inc/Module/AutoInstall.pm
*** Module::AutoInstall version 1.03
*** Checking for Perl dependencies...
[Core Features]
- Catalyst::Runtime ...loaded. (5.71001 >= 5.71001)
- Catalyst::Plugin::ConfigLoader ...loaded. (0.22)
- Catalyst::Plugin::Static::Simple ...loaded. (0.20)
- Catalyst::Action::RenderView ...loaded. (0.09)
- parent ...loaded. (0.221)
- Config::General ...loaded. (2.42)
*** Module::AutoInstall configuration finished.
include inc/Module/Install/WriteAll.pm
include inc/Module/Install/Win32.pm
include inc/Module/Install/Can.pm
include inc/Module/Install/Fetch.pm
Writing Makefile for xymonasset
Writing META.yml
[tjyang@t-fedora11 xymonasset]$
Upgrade Xymon Web GUI
Current Xymon(Hobbit) is coded in C and using CGI and html code to compose a simple web interface.
Recently, we have a few javascript framework choices to upgrade xymon server with RIA web interface.
Using qwikioffice for Xymon Dashboard
qwikioffice Demo Site
Using Tomatocart's admin tool for Xymon administration tool
Xymon Admin Interface
Replace Xymon C/CGI with C/EXTJS
JSON in C
Compilation Errors and Warning
Possible Solutions
To remove "unsigned char" usage hobbit src tree.
find . -type f -name "*.[c|h]" -exec perl -pi -e 's!unsigned\schar!char!g' {} \;
To cast the char that need to be unsigned.
GCC Compilation Warnings
pointer targets in assignment differ in signedness
Why use unsigned char ?
char-vs-unsigned-char
"/usr/include/sys/socket.h:214: note: expected socklen_t * __restrict__ but argument is of type int *"
Compilation Warning on 4.3.0 C source code example listing
[tjyang@f12 4.3.0]$ gmake
MAKE="gmake" CC="gcc" CFLAGS="-g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I`pwd`/include -DCLIENTONLY=1" LDFLAGS="" `pwd`/build/genconfig.sh
Checking for socklen_t
Checking for snprintf
Checking for vsnprintf
Checking for rpc/rpcent.h
Checking for sys/select.h
Checking for u_int32_t typedef
Checking for PATH_MAX definition
Checking for SHUT_RD/WR/RDWR definitions
Checking for strtoll()
config.h created
<snip>
gcc -g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I/home/tjyang/hobbitmon/branches/4.3.0/include -DCLIENTONLY=1 -I. -I../include -c -o digest.o digest.c
digest.c: In function âmd5hashâ:
digest.c:40: warning: pointer targets in passing argument 2 of âmyMD5_Updateâ differ in signedness
/home/tjyang/hobbitmon/branches/4.3.0/include/../lib/md5.h:18: note: expected âunsigned char *â but argument is of type âchar *â
gcc -g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I/home/tjyang/hobbitmon/branches/4.3.0/include -DCLIENTONLY=1 -I. -I../include -c -o encoding.o encoding.c
encoding.c: In function âbase64encodeâ:
encoding.c:31: warning: pointer targets in passing argument 1 of âstrlenâ differ in signedness
/usr/include/string.h:397: note: expected âconst char *â but argument is of type âunsigned char *â
encoding.c:34: warning: pointer targets in passing argument 1 of âstrlenâ differ in signedness
/usr/include/string.h:397: note: expected âconst char *â but argument is of type âunsigned char *â
encoding.c:50: warning: pointer targets in passing argument 1 of âstrlenâ differ in signedness
/usr/include/string.h:397: note: expected âconst char *â but argument is of type âunsigned char *â
encoding.c:60: warning: pointer targets in passing argument 1 of âstrlenâ differ in signedness
/usr/include/string.h:397: note: expected âconst char *â but argument is of type âunsigned char *â
encoding.c:75: warning: pointer targets in return differ in signedness
encoding.c: In function âbase64decodeâ:
encoding.c:86: warning: pointer targets in passing argument 1 of âstrlenâ differ in signedness
/usr/include/string.h:397: note: expected âconst char *â but argument is of type âunsigned char *â
encoding.c:114: warning: pointer targets in return differ in signedness
encoding.c: In function âgetescapestringâ:
encoding.c:125: warning: pointer targets in assignment differ in signedness
encoding.c: In function ânlencodeâ:
encoding.c:181: warning: pointer targets in assignment differ in signedness
encoding.c:183: warning: pointer targets in passing argument 1 of âstrlenâ differ in signedness
/usr/include/string.h:397: note: expected âconst char *â but argument is of type âunsigned char *â
encoding.c:187: warning: pointer targets in assignment differ in signedness
encoding.c:191: warning: pointer targets in assignment differ in signedness
encoding.c:198: warning: pointer targets in passing argument 1 of â__builtin_strcspnâ differ in signedness
encoding.c:198: note: expected âconst char *â but argument is of type âunsigned char *â
encoding.c:198: warning: pointer targets in passing argument 1 of âstrlenâ differ in signedness
/usr/include/string.h:397: note: expected âconst char *â but argument is of type âunsigned char *â
encoding.c:198: warning: pointer targets in passing argument 1 of â__strcspn_c1â differ in signedness
/usr/include/bits/string2.h:971: note: expected âconst char *â but argument is of type âunsigned char *â
encoding.c:198: warning: pointer targets in passing argument 1 of â__strcspn_c2â differ in signedness
/usr/include/bits/string2.h:982: note: expected âconst char *â but argument is of type âunsigned char *â
encoding.c:198: warning: pointer targets in passing argument 1 of â__strcspn_c3â differ in signedness
/usr/include/bits/string2.h:994: note: expected âconst char *â but argument is of type âunsigned char *â
encoding.c:198: warning: pointer targets in passing argument 1 of â__builtin_strcspnâ differ in signedness
encoding.c:198: note: expected âconst char *â but argument is of type âunsigned char *â
encoding.c:198: warning: pointer targets in passing argument 1 of â__builtin_strcspnâ differ in signedness
encoding.c:198: note: expected âconst char *â but argument is of type âunsigned char *â
encoding.c: In function ânldecodeâ:
encoding.c:231: warning: pointer targets in passing argument 1 of â__builtin_strcspnâ differ in signedness
encoding.c:231: note: expected âconst char *â but argument is of type âunsigned char *â
encoding.c:231: warning: pointer targets in passing argument 1 of âstrlenâ differ in signedness
/usr/include/string.h:397: note: expected âconst char *â but argument is of type âunsigned char *â
encoding.c:231: warning: pointer targets in passing argument 1 of â__strcspn_c1â differ in signedness
/usr/include/bits/string2.h:971: note: expected âconst char *â but argument is of type âunsigned char *â
encoding.c:231: warning: pointer targets in passing argument 1 of â__strcspn_c2â differ in signedness
/usr/include/bits/string2.h:982: note: expected âconst char *â but argument is of type âunsigned char *â
encoding.c:231: warning: pointer targets in passing argument 1 of â__strcspn_c3â differ in signedness
/usr/include/bits/string2.h:994: note: expected âconst char *â but argument is of type âunsigned char *â
encoding.c:231: warning: pointer targets in passing argument 1 of â__builtin_strcspnâ differ in signedness
encoding.c:231: note: expected âconst char *â but argument is of type âunsigned char *â
encoding.c:231: warning: pointer targets in passing argument 1 of â__builtin_strcspnâ differ in signedness
encoding.c:231: note: expected âconst char *â but argument is of type âunsigned char *â
<snip>
loadhosts.c: In function âbbh_find_itemâ:
loadhosts.c:228: warning: return discards qualifiers from pointer target type
loadhosts.c: In function âbbh_itemâ:
loadhosts.c:540: warning: pointer targets in passing argument 1 of ânlencodeâ differ in signedness
/home/tjyang/hobbitmon/branches/4.3.0/include/../lib/encoding.h:17: note: expected âunsigned char *â but argument is of type âchar *â
loadhosts.c:540: warning: pointer targets in passing argument 2 of âaddtobufferâ differ in signedness
/home/tjyang/hobbitmon/branches/4.3.0/include/../lib/strfunc.h:16: note: expected âchar *â but argument is of type âunsigned char *â
loadhosts.c: In function âbbh_item_idâ:
loadhosts.c:619: warning: return discards qualifiers from pointer target type
<snip>
msort.c: In function âmsortâ:
msort.c:119: warning: passing argument 4 of âqsortâ from incompatible pointer type
/usr/include/stdlib.h:756: note: expected â__compar_fn_tâ but argument is of type âint (*)(void **, void **)â
<snip>
sha2.c: In function âmySHA224_Finalâ:
sha2.c:972: warning: pointer targets in passing argument 2 of âsha224_finalâ differ in signedness
sha2.c:812: note: expected âunsigned char *â but argument is of type âchar *â
sha2.c: In function âmySHA256_Finalâ:
sha2.c:977: warning: pointer targets in passing argument 2 of âsha256_finalâ differ in signedness
sha2.c:417: note: expected âunsigned char *â but argument is of type âchar *â
gcc -g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I/home/tjyang/hobbitmon/branches/4.3.0/include -DCLIENTONLY=1 -I. -I../include -c -o sig.o sig.c
<snip>
gcc -g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I/home/tjyang/hobbitmon/branches/4.3.0/include -DCLIENTONLY=1 -I. -I../include -DCLIENTONLY -c -o timefunc-client.o timefunc.c
ar cr hobbitclient.a osdefs.o cgiurls.o color-client.o digest.o encoding.o environ-client.o errormsg.o holidays.o ipaccess.o loadhosts.o md5.o memory.o misc.o msort.o rbtr.o rmd160c.o sendmsg.o sha1.o sha2.o sig.o stackio.o strfunc.o suid.o timefunc-client.o
ranlib hobbitclient.a || echo ""
gmake[1]: Leaving directory `/home/tjyang/hobbitmon/branches/4.3.0/lib'
CC="gcc" CFLAGS="-g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I`pwd`/include -DCLIENTONLY=1" LDFLAGS="" RPATHOPT="-Wl,--rpath," SSLFLAGS="" SSLINCDIR="" SSLLIBS="" NETLIBS="" LIBRTDEF="-lrt" BBHOME="/home/xymon/client" gmake -C common client
gmake[1]: Entering directory `/home/tjyang/hobbitmon/branches/4.3.0/common'
<snip>
gcc -g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I/home/tjyang/hobbitmon/branches/4.3.0/include -DCLIENTONLY=1 -c -o bbdigest.o bbdigest.c
bbdigest.c: In function âmainâ:
bbdigest.c:48: warning: pointer targets in passing argument 2 of âdigest_dataâ differ in signedness
/home/tjyang/hobbitmon/branches/4.3.0/include/../lib/digest.h:26: note: expected âunsigned char *â but argument is of type âchar *â
gcc -g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I/home/tjyang/hobbitmon/branches/4.3.0/include -DCLIENTONLY=1 -o ../client/bbdigest bbdigest.o ../lib/hobbitclient.a -lrt
gmake[1]: Leaving directory `/home/tjyang/hobbitmon/branches/4.3.0/common'
CC="gcc" CFLAGS="-g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I`pwd`/include -DCLIENTONLY=1" LDFLAGS="" RPATHOPT="-Wl,--rpath," SSLLIBS="" NETLIBS="" LIBRTDEF="-lrt" BBHOME="/home/xymon/client" gmake -C build all
gmake[1]: Entering directory `/home/tjyang/hobbitmon/branches/4.3.0/build'
gcc -o merge-lines -g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I/home/tjyang/hobbitmon/branches/4.3.0/include -DCLIENTONLY=1 merge-lines.c
gcc -o merge-sects -g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I/home/tjyang/hobbitmon/branches/4.3.0/include -DCLIENTONLY=1 merge-sects.c
gcc -o setup-newfiles -g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I/home/tjyang/hobbitmon/branches/4.3.0/include -DCLIENTONLY=1 -Wl,--rpath, setup-newfiles.c ../lib/hobbitclient.a -lrt
setup-newfiles.c: In function âmainâ:
setup-newfiles.c:27: warning: pointer targets in assignment differ in signedness
setup-newfiles.c:79: warning: pointer targets in passing argument 1 of âstrstrâ differ in signedness
/usr/include/string.h:340: note: expected âconst char *â but argument is of type âunsigned char *â
gmake[1]: Leaving directory `/home/tjyang/hobbitmon/branches/4.3.0/build'
CC="gcc" CFLAGS="-g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I`pwd`/include -DCLIENTONLY=1" BBHOME="/home/xymon/client" BBHOSTIP="127.0.0.1" LOCALCLIENT="no" NETLIBS="" LIBRTDEF="-lrt" gmake -C client all
gmake[1]: Entering directory `/home/tjyang/hobbitmon/branches/4.3.0/client'
<snip>
msgcache.c: In function âmainâ:
msgcache.c:537: warning: pointer targets in passing argument 3 of âacceptâ differ in signedness
/usr/include/sys/socket.h:214: note: expected âsocklen_t * __restrict__â but argument is of type âint *â
cat hobbitclient.cfg.DIST | sed -e 's!@BBHOSTIP@!127.0.0.1!g' >hobbitclient.cfg
../build/bb-commands.sh >>hobbitclient.cfg
cat clientlaunch.cfg.DIST | sed -e 's!@CLIENTFLAGS@!!g' >clientlaunch.cfg
gmake[1]: Leaving directory `/home/tjyang/hobbitmon/branches/4.3.0/client'
Build complete. Now run 'gmake install' as root
[tjyang@f12 4.3.0]$
Xymon GUI ideas
GUI Requirements
Keep cgi+html+tigramenu for legacy support.
Include modern Javascript GUI framework like extjs or jQuery.
Provide realtime web GUI update from clients using AJAX.
Waiting for 1+ minutes to see the changes from web page is barely acceptable but hope to avoid.
From Neil Franken
Use CSS to provide easy theme and resolution change.
Resolutions:
Themes:
Enable fine-grained control on columns in different views.
From T.J. Yang
I found following combination of existing opensource software can make up a new GUI for Xymon.
End user can still see old cgi+html GUI.
Use extjs for new GUI and miframe.js to contain old tigra menu GUI in a frame.
See Xymon Desktop Prototype.December 2011
Using command line tool to update this wiki book
Installation of mediawiki client in perl
Mediawik command line tool
A makefile script to automate the hobbit documentation effort.