Website log analysis

应用菜单
Domain

1.Analytical Spider

* Please check the search engine spiders you want to analyze;

2.Spider authenticity

* No verification: No verification of spider IP is performed, and the authenticity of search engine spiders cannot be distinguished;
* Online verification: verify the authenticity of spiders from the known search engine spider IP database;
* If your website uses CDN acceleration and does not return to the source, the website log IP may be the CDN IP, so please check [No verification];

3.Select Log

Click to select log file
    Start analysis
    * Log files support txt and log formats;
    View analysis results: Search engine spider comprehensive analysis, Search engine spider visits in the past 30 days
    * You can click on the corresponding link to view the spider log analysis results;

    Spider Log

    • Analyze your website search spider crawling based on AI algorithm, analyze the website in multiple dimensions, and display the website spider analysis results more intuitively.
    • Support iis/apache/nginx server website log spider analysis.
    • Provide different ways of data import, upload log files, log paste, API access methods.
    • Website crawling anomaly
    • Analyze website anomaly;
    • Detect search spider crawling anomaly;
    • Website anomaly investigation;
    • Spider crawling statistics
    • Statistical spider crawling overview;
    • Optimize websites for different search engines;
    • Analyze website optimization overview;
    • Distinguish between true and false spiders
    • Intelligently identify true and false spiders on websites;
    • Fake spiders should be banned in time;
    • Avoid malicious collection of websites resulting in low quality websites;
    • Spider behavior analysis
    • Spider access behavior analysis;
    • Statistical search spider sources;
    • Statistics of abnormal crawling of search spiders;
    • Spider data analysis
    • Statistics of search spider access overview;
    • Multi-search engine identification;
    • Intelligent analysis based on AI algorithm;
    • Log analysis report
    • Generate log analysis report;
    • Spider access abnormality export;
    • Improve website SEO optimization;

    About

    • About

      Easy to use

      No programming required, users can quickly create spider log analysis projects, and the system will automatically perform operations.

    • About

      No maintenance required

      We will provide users with a convenient spider log analysis tool through unified system maintenance and function upgrades.

    • About

      Log upload

      Supports uploading of large file website logs, supporting log formats of txt and log; log upload and analysis are performed simultaneously.

    • About

      Data Analysis

      Supports structured log retrieval, multi-structure log analysis reports, and automatic classification of analysis results.

    Log analysis

    • Message Queuing

      message queuing

    • Log Parsing

      Log parsing

    • Object Storage

      Object storage

    • Analysis Engine

      Analysis engine