parduscycle.com
robots.txt

Robots Exclusion Standard data for parduscycle.com

Resource Scan

Scan Details

Site Domain parduscycle.com
Base Domain parduscycle.com
Scan Status Ok
Last Scan2025-10-21T06:22:38+00:00
Next Scan 2025-11-20T06:22:38+00:00

Last Scan

Scanned2025-10-21T06:22:38+00:00
URL https://parduscycle.com/robots.txt
Domain IPs 58.218.215.77
Response IP 58.218.215.105
Found Yes
Hash 9a9e141c16b453566822e5c9e38dfdc38e48cb873368a0636015eecc03cb190a
SimHash c910d870d353

Groups

*

Rule Path
Disallow /taishan/

googlebot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

toutiaospider

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5