main20.site
robots.txt

Robots Exclusion Standard data for main20.site

Resource Scan

Scan Details

Site Domain main20.site
Base Domain main20.site
Scan Status Ok
Last Scan2025-11-16T10:15:59+00:00
Next Scan 2025-12-16T10:15:59+00:00

Last Scan

Scanned2025-11-16T10:15:59+00:00
URL https://main20.site/robots.txt
Domain IPs 104.21.54.77, 172.67.136.195, 2606:4700:3030::ac43:88c3, 2606:4700:3031::6815:364d
Response IP 172.67.136.195
Found Yes
Hash 4c3fc46e86d0b5e488ba7ddcdf313418d8fcfa56643163708b60d3e89fc76ff1
SimHash 685081956735

Groups

googlebot
slurp
bingbot

Rule Path
Allow /

*

Rule Path
Allow /