wral-tv.com
robots.txt
Robots Exclusion Standard data for wral-tv.com
Resource Scan
Scan Details
Site Domain | wral-tv.com |
Base Domain | wral-tv.com |
Scan Status | Ok |
Last Scan | 2024-05-22T05:04:43+00:00 |
Next Scan | 2024-05-29T05:04:43+00:00 |
Last Scan
Scanned | 2024-05-22T05:04:43+00:00 |
URL | http://wral-tv.com/robots.txt |
Redirect | https://www.wral.com/robots.txt |
Redirect Domain | www.wral.com |
Redirect Base | wral.com |
Domain IPs | 64.128.222.18 |
Redirect IPs | 18.154.132.121, 18.154.132.50, 18.154.132.76, 18.154.132.98, 2600:9000:2778:4200:18:336d:ed40:93a1, 2600:9000:2778:4c00:18:336d:ed40:93a1, 2600:9000:2778:5a00:18:336d:ed40:93a1, 2600:9000:2778:600:18:336d:ed40:93a1, 2600:9000:2778:9600:18:336d:ed40:93a1, 2600:9000:2778:a200:18:336d:ed40:93a1, 2600:9000:2778:b200:18:336d:ed40:93a1, 2600:9000:2778:ce00:18:336d:ed40:93a1 |
Response IP | 108.157.52.87 |
Found | Yes |
Hash | 6b6bac37cda85d824a113e997bc4739e9cee579d70c9617d231cd5c417b4b3a0 |
SimHash | 8d37580db5d4 |
Groups
grapeshot
ia_archiver
bingbot
bing
facebot
facebookexternalhit
googlebot
google
mediapartners-google
slurp
twitterbot
Rule | Path |
---|---|
Disallow | /apps/ |
Disallow | /*?print_friendly |
Disallow | /golo/page/1896337/ |
Disallow | /rs/page/2173068/ |
Disallow | /weather/page/1010362/?id=* |
Disallow | /weather/?wc_img=* |
Disallow | /arrest-photos/8981628/ |
Disallow | /sports/ |
Disallow | /search/ |
Disallow | /content/creative_services/promos/clickthru?* |
Disallow | /suggest-a-correction/ |
Other Records
Field | Value |
---|---|
sitemap | http://www.wral.com/sitemap_index.xml |
Comments