metropcs.mobi
robots.txt

Robots Exclusion Standard data for metropcs.mobi

Resource Scan

Scan Details

Site Domain metropcs.mobi
Base Domain metropcs.mobi
Scan Status Ok
Last Scan2024-10-06T14:20:26+00:00
Next Scan 2024-10-13T14:20:26+00:00

Last Scan

Scanned2024-10-06T14:20:26+00:00
URL https://metropcs.mobi/robots.txt
Domain IPs 18.66.196.45, 18.66.196.54, 18.66.196.59, 18.66.196.96
Response IP 18.165.140.109
Found Yes
Hash 4368792308236ff4d2f2654a4be446e81107346b48ce57938579b6f028f9c40b
SimHash 8c14cfd427d3

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

dotbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

clickagy intelligence bot v2

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

fuzz faster u fool*

Rule Path
Disallow /

*

Rule Path
Disallow