stats.nets4.com
robots.txt

Robots Exclusion Standard data for stats.nets4.com

Resource Scan

Scan Details

Site Domain stats.nets4.com
Base Domain nets4.com
Scan Status Ok
Last Scan2025-04-02T01:29:32+00:00
Next Scan 2025-05-02T01:29:32+00:00

Last Scan

Scanned2025-04-02T01:29:32+00:00
URL https://stats.nets4.com/robots.txt
Domain IPs 104.21.63.59, 172.67.143.221, 2606:4700:3034::6815:3f3b, 2606:4700:3037::ac43:8fdd
Response IP 172.67.143.221
Found Yes
Hash 94b5d2e4ce19290bf4fa226c435ff16cfc082bf59cd3585993412979a72a1278
SimHash 2c5dde54a341

Groups

googlebot

Rule Path
Disallow /search.php

Other Records

Field Value
crawl-delay 300

adsbot-google

Rule Path
Disallow /search.php

googlebot-image

Rule Path
Disallow /search.php

Other Records

Field Value
crawl-delay 300

bingbot

Rule Path
Disallow /search.php

Other Records

Field Value
crawl-delay 300

yandex

Rule Path
Disallow /search.php

Other Records

Field Value
crawl-delay 300

baiduspider

Rule Path
Disallow /search.php

Other Records

Field Value
crawl-delay 300

internetarchivebot

Rule Path
Disallow /search.php

Other Records

Field Value
crawl-delay 300

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://nets4.com/sitemap.xml
sitemap https://nets4.com/sitemap-domains.xml