38 lines of PHP code free import database analysis Linux access log

Used to analyze linux Exception of log file IP, For example, high frequency visits to spiders , High frequency vulnerability detection URL Of IP

The system will press IP The number of visits is sorted , You can analyze their behavior hundreds of times .

such as [email protected] More times ,URL Most of them are not your common paths , The IP That is to scan website vulnerabilities .

such as IP The number of many ,UA Have a website address or include spider/bot/crawler Wait is a spider ,python-requests Artificial wild spider

Performance reference ：1 nucleus 1GBwin Server Analysis 76.5852MB/404101 Logs @ Time consuming [email protected] Memory 20,795.22KB

 

<?php
header("Content-type:text/html;charset=utf-8");
ob_implicit_flush();
set_time_limit(9000); // Suggest to modify PHP The timeout of the corresponding version 100 For larger values such as 9000
echo "<style>table{border-top:2px solid #0180CF; margin:0 auto;font-size:12px;width:99%;}
table td{min-width:66px;border-bottom:1px solid #a2c6d3;padding:5px 0px;word-wrap:break-word;word-break:break-all;}
table tr:nth-child(even){background: #FCFCFC;}
.tt{background:#e5f2fa;line-height:18px;FONT-SIZE:12px;font-weight:600;}</style>";
function readcsv($filex){
    $handle = fopen($filex, "r");
    while ($data = fgetcsv($handle,0," ")) {
    yield $data; //php 5.5+
    }
    fclose($handle);
}
$start = microtime(true);
$mstar = memory_get_usage();
$biaoge = "{$biaoge}_loge";
$filex= "./***.log"; // modify linux Log file path 
echo "<h1> Statistics IP Traffic volume ($filex)</h1> Used to analyze exceptions IP, For example, high frequency visits to spiders , High frequency vulnerability detection URL Of IP";
$ii=0; $iz=0; $sqla = array(); $sqlb = array();
foreach (readcsv($filex) as $key => $kar) {
$ii++; $ipx = $kar[0]."@".$kar[6]; $kall = $ii."\t".join("\t",$kar);
if(!$sqla[$ipx]){ $sqla[$ipx] = 1; $sqlb[$ipx] = $kall; }else{ $sqla[$ipx] += 1;}  
}
arsort($sqla); 
echo "<table>";
echo "<tr class='tt'><td width='80'>[email protected] state </td><td width='40'> frequency </td><td> sample </td></tr>";
foreach ($sqla as $tip => $tcs) { 
echo "<tr><td>$tip</td><td>$tcs</td><td>".$sqlb[$tip]."</td></tr>";
} 
echo "</table>";
$sstop = microtime(true); $mstop = memory_get_usage();
$fsize = number_format(filesize($filex)/1024/1024,2);
$us = "<p> analysis {$fsize}MB/{$ii} Logs @ Time consuming ".number_format($sstop-$start, 2);
$us .= "@ Memory consumption ".number_format(($mstop-$mstar)/1024, 2)."KB";
$us .= "/ total ".number_format(memory_get_peak_usage()/1024,2).'KB</p>';
echo $us;