pi-lite.spectrum.net
robots.txt

Robots Exclusion Standard data for pi-lite.spectrum.net

Resource Scan

Scan Details

Site Domain pi-lite.spectrum.net
Base Domain spectrum.net
Scan Status Ok
Last Scan2024-09-28T16:31:11+00:00
Next Scan 2024-10-28T16:31:11+00:00

Last Scan

Scanned2024-09-28T16:31:11+00:00
URL https://pi-lite.spectrum.net/robots.txt
Domain IPs 3.212.171.220, 34.235.236.199, 98.83.100.177
Response IP 3.212.171.220
Found Yes
Hash ed591171deac4f978af7ab4d7acec0dfb8ccfbd5210c0ab7a889a2767a25806f
SimHash 6d54dbb4d5d5

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Allow /tdcs/public/inform/

apis-google

Rule Path
Allow /tdcs/public/inform/

mediapartners-google

Rule Path
Allow /tdcs/public/inform/

adsbot-google-mobile

Rule Path
Allow /tdcs/public/inform/

adsbot-google

Rule Path
Allow /tdcs/public/inform/

duckduckbot

Rule Path
Allow /tdcs/public/inform/

slurp

Rule Path
Allow /tdcs/public/inform/

bingbot

Rule Path
Allow /tdcs/public/inform/

adidxbot

Rule Path
Allow /tdcs/public/inform/

bingpreview

Rule Path
Allow /tdcs/public/inform/