gikme.pl
robots.txt

Robots Exclusion Standard data for gikme.pl

Resource Scan

Scan Details

Site Domain gikme.pl
Base Domain gikme.pl
Scan Status Ok
Last Scan2025-10-24T01:19:12+00:00
Next Scan 2025-11-23T01:19:12+00:00

Last Scan

Scanned2025-10-24T01:19:12+00:00
URL https://gikme.pl/robots.txt
Domain IPs 104.21.90.93, 172.67.155.105
Response IP 172.67.155.105
Found Yes
Hash e956288544b2aca1edb089a3f5f41d564a89840cc2441ea387c56e052310a267
SimHash 60008a560731

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /xmlrpc.php

Comments

  • global

Warnings

  • 1 invalid line.