mtvwe.com
robots.txt
Robots Exclusion Standard data for mtvwe.com
Resource Scan
Scan Details
Site Domain | mtvwe.com |
Base Domain | mtvwe.com |
Scan Status | Ok |
Last Scan | 2024-11-11T07:19:12+00:00 |
Next Scan | 2024-11-18T07:19:12+00:00 |
Last Scan
Scanned | 2024-11-11T07:19:12+00:00 |
URL | http://mtvwe.com/robots.txt |
Domain IPs | 118.69.168.104 |
Response IP | 118.69.168.104 |
Found | Yes |
Hash | f4614cc3a0c9352606c7e34d07c23a0dc0eca85b420982abbd1cda06a60fecc2 |
SimHash | 1904ec036f32 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /ad/ |
Disallow | /cache/ |
Disallow | /config/ |
Disallow | /definfo/ |
Disallow | /modules/ |
Disallow | /poster/ |
Disallow | /templates/ |
Disallow | /utils/ |
Disallow | /test/ |
Other Records
Field | Value |
---|---|
sitemap | http://mtvwe.com/sitemap/sitemap.xml.gz |
sitemap | http://www.mtvwe.com/sitemap/sitemap.xml.gz |