tamideblog.pl
robots.txt

Robots Exclusion Standard data for tamideblog.pl

Resource Scan

Scan Details

Site Domain tamideblog.pl
Base Domain tamideblog.pl
Scan Status Ok
Last Scan2024-09-22T13:08:45+00:00
Next Scan 2024-09-29T13:08:45+00:00

Last Scan

Scanned2024-09-22T13:08:45+00:00
URL https://tamideblog.pl/robots.txt
Domain IPs 104.21.32.46, 172.67.183.21, 2606:4700:3036::6815:202e, 2606:4700:3036::ac43:b715
Response IP 172.67.183.21
Found Yes
Hash 870f7a59407a8e2d7e8690049d8b8d6d84b81f8927513e5d0011ae7c9c2b4ecc
SimHash 4000ca222ba2

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Disallow /mailpoet_page-sitemap.xml
Allow /wp-admin/admin-ajax.php