devilsindetail.com
robots.txt
Robots Exclusion Standard data for devilsindetail.com
Resource Scan
Scan Details
Site Domain | devilsindetail.com |
Base Domain | devilsindetail.com |
Scan Status | Ok |
Last Scan | 2024-10-25T11:04:04+00:00 |
Next Scan | 2024-11-01T11:04:04+00:00 |
Last Scan
Scanned | 2024-10-25T11:04:04+00:00 |
URL | https://devilsindetail.com/robots.txt |
Domain IPs | 13.33.30.100, 13.33.30.117, 13.33.30.25, 13.33.30.56, 2600:9000:229f:2200:b:9c0b:f980:93a1, 2600:9000:229f:2400:b:9c0b:f980:93a1, 2600:9000:229f:400:b:9c0b:f980:93a1, 2600:9000:229f:9e00:b:9c0b:f980:93a1, 2600:9000:229f:a00:b:9c0b:f980:93a1, 2600:9000:229f:ca00:b:9c0b:f980:93a1, 2600:9000:229f:dc00:b:9c0b:f980:93a1, 2600:9000:229f:f200:b:9c0b:f980:93a1 |
Response IP | 13.33.30.100 |
Found | Yes |
Hash | ce72656ccbd7c524ab62c91cecc1b3b9b8c38ac4a14cce6a76522128b4734bf7 |
SimHash | 6a04400a8de2 |
Groups
*
Rule | Path |
---|---|
Allow | / |
*
Rule | Path |
---|---|
Disallow | */?*utm_source=* |
Disallow | */?*utm_campaign=* |
Disallow | */?*utm_medium=* |
Disallow | /*?source=* |
Disallow | */?*utm_newsbreak=* |
*
Rule | Path |
---|---|
Allow | /ads.txt |
*
Rule | Path |
---|---|
Disallow | *?embed* |
*
Rule | Path |
---|---|
Disallow | */*a_aid%3D* |
Disallow | /*?partner=* |
*
Rule | Path |
---|---|
Disallow | */*?mm-experiments=* |
*
Rule | Path |
---|---|
Disallow | /*?*s=* |
*
Rule | Path |
---|---|
Disallow | *?app=* |
*
Rule | Path |
---|---|
Disallow | *?fbclid=* |
*
Rule | Path |
---|---|
Disallow | /*?setLocale=* |
Disallow | *?georedirect=* |
*
Rule | Path |
---|---|
Disallow | /*?term=* |
Disallow | *?ref=* |
Disallow | /*?view_source=* |
Disallow | /*?view_medium=* |
Disallow | /*?initialLeagueId=* |
*
Rule | Path |
---|---|
Disallow | *_ga_* |
Disallow | */?_gl=* |
*
Rule | Path |
---|---|
Disallow | */api/* |
*
Rule | Path |
---|---|
Disallow | */videos/undefinedc_fill%2Cw_360%2Car_16%3A9%2Cf_auto%2Cq_auto%2Cg_auto/undefined |
Disallow | */teams/mainNavigationChevron_icon.svg?* |
Disallow | */leagues/mainNavigationChevron_icon.svg?* |
Disallow | */undefinedc_fill%2Cw_360%2Car_16%3A9%2Cf_auto%2Cq_auto%2Cg_auto/undefined |
*
Rule | Path |
---|---|
Disallow | */xposts/ |
Disallow | */reader/ |
Disallow | */embed/* |
Disallow | */ads/* |
Disallow | */editor/* |
Disallow | */posts/*/edit$ |
Disallow | */posts/*/publish$ |
Disallow | */singlepage/pipe/* |
Disallow | */singlepage/uncached_pipe/* |
Disallow | */singlepage/epipe/* |
Disallow | */reads/*/read$ |
Disallow | */embed_code |
Disallow | */matches/* |
Disallow | */es/partidos/* |
Disallow | */it/partite/* |
Disallow | */de/spiele/* |
Disallow | */zh-CN/* |
Disallow | */ping |
Disallow | */sessions/* |
Disallow | */admin/* |
Disallow | */management/* |
Disallow | */castr |
Disallow | */unfeature$ |
Disallow | */unfeature/* |
Disallow | */videos/* |
Disallow | */channels/videos/* |
*
Rule | Path |
---|---|
Disallow | /_partial/* |
Disallow | */amazingfactgenerator/* |
Disallow | /_modules/* |
Disallow | /subscribe/v3/* |
Disallow | /search/* |
Disallow | */file/* |
Disallow | */node/* |
Disallow | /sites/* |
Disallow | /longform/* |
Disallow | /blogs/* |
Disallow | */store/* |
Disallow | */us/* |
Disallow | */store/* |
Disallow | */us/* |
Disallow | */HDYK/* |
Disallow | /dist/* |
Disallow | */shopping/* |
Disallow | /trivia/* |
Disallow | /worksheets/* |
Disallow | /music/* |
Disallow | /magazine/* |
Disallow | /puzzle/* |
*
Rule | Path |
---|---|
Disallow | */files/* |
Disallow | */wp-admin/* |
Disallow | */?*utm_newsbreak=* |
Disallow | */wp-content/* |
Disallow | */wp-includes/* |
Disallow | */app/* |
Disallow | */embed_code* |
Disallow | */%7B%7Burl/* |
Disallow | */v2/* |
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
sitemap | https://devilsindetail.com/news-sitemap.xml |
sitemap | https://devilsindetail.com/feed-sitemap.xml |
sitemap | https://devilsindetail.com/sitemap.xml |
Warnings
- 2 invalid lines.
Comments