mpweekly.com
robots.txt

Robots Exclusion Standard data for mpweekly.com

Resource Scan

Scan Details

Site Domain mpweekly.com
Base Domain mpweekly.com
Scan Status Ok
Last Scan2024-09-26T00:57:40+00:00
Next Scan 2024-10-03T00:57:40+00:00

Last Scan

Scanned2024-09-26T00:57:40+00:00
URL https://mpweekly.com/robots.txt
Redirect https://www.mpweekly.com/robots.txt
Redirect Domain www.mpweekly.com
Redirect Base mpweekly.com
Domain IPs 103.63.135.219
Redirect IPs 132.147.114.72, 138.113.112.18, 138.113.53.41
Response IP 138.113.112.18
Found Yes
Hash 28d0db0441a71e5dffc4d3790a536b4fed3cd441c974d82e19e3298424f62a97
SimHash 0895c8015c03

Groups

*

Rule Path
Disallow /entertainment/search/
Disallow /culture/search/
Disallow /inner/search/
Disallow /neo-ent/
Disallow /entertainment/wp-admin/
Disallow /entertainment/test/
Disallow /culture/wp-admin/
Disallow /inner/wp-admin/
Disallow /culture/uncategorized
Disallow /entertainment/uncategorized
Disallow /inner/uncategorized
Disallow /feed
Disallow /entertainment/tag/
Disallow /culture/tag/
Disallow /inner/tag/

rogerbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.mpweekly.com/entertainment/sitemap.xml
sitemap https://www.mpweekly.com/culture/sitemap.xml
sitemap https://www.mpweekly.com/inner/sitemap.xml