Proxylizer/Getting Started: Difference between revisions

From MikroTik Wiki
Jump to navigation Jump to search
(6 intermediate revisions by the same user not shown)
Line 12: Line 12:
# [[Proxylizer/Getting Started#Web server with PHP and PHP-Pear | Web server with PHP and PHP-Pear]]
# [[Proxylizer/Getting Started#Web server with PHP and PHP-Pear | Web server with PHP and PHP-Pear]]
# [[Proxylizer/Getting Started#MySQL database server | MySQL database server]]
# [[Proxylizer/Getting Started#MySQL database server | MySQL database server]]
# [[Proxylizer/Getting Started#MySQL user created for proxylizer database | MySQL user created for proxylizer database]]
# [[Proxylizer/Getting Started#MySQL user for proxylizer database | MySQL user for proxylizer database]]
# [[Proxylizer/Getting Started#Scripts/daemons forwarding records from syslog to MySQL | Scripts/daemons forwarding records from syslog to MySQL]]
# [[Proxylizer/Getting Started#Scripts/daemons forwarding records from syslog to MySQL | Scripts/daemons forwarding records from syslog to MySQL]]
# [[Proxylizer/Getting Started#Scheduled scripts for report generation | Scheduled scripts for report generation]]
# [[Proxylizer/Getting Started#Scheduled scripts for report generation | Scheduled scripts for report generation]]
Line 18: Line 18:
===Mikrotik router===
===Mikrotik router===
==== Web-proxy log export to remote host ====
==== Web-proxy log export to remote host ====
TODO
To forward logs from Mikrotik Router to Proxylizer server, open RouterOS console and type in the following commands:
 
<pre>/system logging action add name=sendToProxylizer target=remote remote=10.1.1.2:514
/system logging add topics=web-proxy action=sendToProxylizer</pre>
 
Note that logs are sent to port number 514, it must be equal with the port on which Syslog daemon on Proxylizer server is listening.


===Proxylizer server===
===Proxylizer server===
Line 49: Line 54:
<pre>
<pre>
destination d_mysql {
destination d_mysql {
#file("/var/log/proxy.log");
pipe("/home/proxylizer/mysql.pipe"
pipe("/home/proxylizer/mysql.pipe"
template("$HOST $YEAR-$MONTH-$DAY $HOUR:$MIN:$SEC $MSG\n") template-escape(yes));
template("$HOST $YEAR-$MONTH-$DAY $HOUR:$MIN:$SEC $MSG\n") template-escape(yes));
Line 77: Line 81:
<pre> apt-get install mysql-server mysql-client </pre>
<pre> apt-get install mysql-server mysql-client </pre>


==== MySQL user created for proxylizer database ====
==== MySQL user for proxylizer database ====


Default user name for mysql database is root with no password. But we recomend to change it for security reasons.<br> Connect to mysql server and create new database and user.
Default user name for mysql database is root with no password. But we recomend to change it for security reasons.<br> Connect to mysql server and create new database and user.
Line 94: Line 98:
==== Scheduled scripts for report generation ====
==== Scheduled scripts for report generation ====


   
Create directory for script logs and set permesions.
<pre>
<pre>
mkdir /var/log/proxylizer
mkdir /var/log/proxylizer
Line 109: Line 113:
SHELL=/bin/sh
SHELL=/bin/sh
PATH=/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin
PATH=/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin
* *    * * *          cd /var/www/proxylizer/ && ./mail_send.php >> /var/log/mail_send_log.log
* *    * * *          /var/www/proxylizer/mail_send.php >> /var/log/mail_send_log.log
* *    * * *          /var/www/proxylizer/checkwebproxy.sh >> /var/log/checkwebproxy.log &
* *    * * *          /var/www/proxylizer/checkwebproxy.sh >> /var/log/checkwebproxy.log &
</pre>
</pre>
Set scheduler tasks from this file
Set scheduler tasks from this file
<pre>crontab proxylizercrontab</pre>
<pre>crontab proxylizercrontab</pre>

Revision as of 10:30, 7 January 2009

Install

All the examples assume that Proxylizer server IP address is 10.1.1.2;

The installation includes steps for setting up the following:

  1. Web-proxy log export to remote host (Proxylizer server)
  1. Web page scripts
  2. Permissions for directories
  3. Syslog deamon
  4. Web server with PHP and PHP-Pear
  5. MySQL database server
  6. MySQL user for proxylizer database
  7. Scripts/daemons forwarding records from syslog to MySQL
  8. Scheduled scripts for report generation

Mikrotik router

Web-proxy log export to remote host

To forward logs from Mikrotik Router to Proxylizer server, open RouterOS console and type in the following commands:

/system logging action add name=sendToProxylizer target=remote remote=10.1.1.2:514
/system logging add topics=web-proxy action=sendToProxylizer

Note that logs are sent to port number 514, it must be equal with the port on which Syslog daemon on Proxylizer server is listening.

Proxylizer server

All the examples assume that web page root directory is "/var/www/proxylizer", web server user is "www-data", Proxylizer server system user is "proxylizer" and .pipe file destination/name is "/home/proxylizer/mysql.pipe".

Web page scripts

TODO

Permissions for directories

Open console. Change ownership of web page root directory for web server user

 chown proxylizer:www-data /var/www/proxylizer -R 

Set write permissions to web page root directory for web server user

 chmod g+w /var/www/proxylizer 

Set permissions to execute 3 shell script files for web server user group.

cd /var/www/proxylizer
chmod g+x checkwebproxy.sh mail_send.php webproxylogtomysql.php

Syslog daemon

Install syslog-ng daemon.

apt-get install syslog-ng

WARNING : If you have Ubuntu OS syslog-ng can conflict with ubuntu-minimal package! You can remove this package.

Change syslog-ng config to receive logs from Mikrotik router and put them into mysql.pipe file. Open /etc/syslog-ng/syslog-ng.conf and add these lines next to "#destinations"

destination d_mysql {
pipe("/home/proxylizer/mysql.pipe"
template("$HOST $YEAR-$MONTH-$DAY $HOUR:$MIN:$SEC $MSG\n") template-escape(yes));
};
log { source(net); destination(d_mysql); };

And this line next to "#sources"

source net { udp(); }

Create pipe file.

mkfifo /home/proxylizer/mysql.pipe

Set destination of .pipe file in /var/www/proxylizer/webproxylogtomysql.php. At the beginning of the file you must change variable value in the line

$MYSQL_PIPE = "/home/proxylizer/mysql.pipe";

restart syslog

/etc/init.d/syslog-ng restart

Web server with PHP and PHP-Pear

Install web server (we recommend Apache2), PHP5, PHP5-cli and PHP-Pear : DB, Mail, Mail_Mime and Net_SMTP packages.

apt-get install libapache2-mod-php5 php5-cli php-pear php-db php-mail php-mail-mime php-net-smtp

MySQL database server

Install MySQL database server.

 apt-get install mysql-server mysql-client 

MySQL user for proxylizer database

Default user name for mysql database is root with no password. But we recomend to change it for security reasons.
Connect to mysql server and create new database and user.

mysql -u root
create database proxylizerdb;
grant all privileges on proxylizerdb.* to proxylizer@localhost identified by "password" with grant option;
flush privileges;

Scripts/daemons forwarding records from syslog to MySQL

Start php script, that will read from mysql.pipe file, and insert records in database.

/var/www/proxylizer/webproxylogtomysql.php

Scheduled scripts for report generation

Create directory for script logs and set permesions.

mkdir /var/log/proxylizer
chown proxylizer:proxylizer /var/log/proxylizer
chmod u+w /var/log/proxylizer

Put two scripts in cron sheduler. First create crontab file for web server system user

nano /home/proxylizer/proxylizercrontab

and copy these lines.

SHELL=/bin/sh
PATH=/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin
* *     * * *           /var/www/proxylizer/mail_send.php >> /var/log/mail_send_log.log
* *     * * *           /var/www/proxylizer/checkwebproxy.sh >> /var/log/checkwebproxy.log &

Set scheduler tasks from this file

crontab proxylizercrontab