api.spectrum.net
robots.txt

Robots Exclusion Standard data for api.spectrum.net

Resource Scan

Scan Details

Site Domain api.spectrum.net
Base Domain spectrum.net
Scan Status Ok
Last Scan2024-09-29T05:13:19+00:00
Next Scan 2024-10-29T05:13:19+00:00

Last Scan

Scanned2024-09-29T05:13:19+00:00
URL https://api.spectrum.net/robots.txt
Domain IPs 71.74.45.59
Response IP 71.74.45.59
Found Yes
Hash ed591171deac4f978af7ab4d7acec0dfb8ccfbd5210c0ab7a889a2767a25806f
SimHash 6d54dbb4d5d5

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Allow /tdcs/public/inform/

apis-google

Rule Path
Allow /tdcs/public/inform/

mediapartners-google

Rule Path
Allow /tdcs/public/inform/

adsbot-google-mobile

Rule Path
Allow /tdcs/public/inform/

adsbot-google

Rule Path
Allow /tdcs/public/inform/

duckduckbot

Rule Path
Allow /tdcs/public/inform/

slurp

Rule Path
Allow /tdcs/public/inform/

bingbot

Rule Path
Allow /tdcs/public/inform/

adidxbot

Rule Path
Allow /tdcs/public/inform/

bingpreview

Rule Path
Allow /tdcs/public/inform/