maxjav.com
robots.txt
Robots Exclusion Standard data for maxjav.com
Resource Scan
Scan Details
Site Domain | maxjav.com |
Base Domain | maxjav.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-05-03T14:15:15+00:00 |
Next Scan | 2024-08-01T14:15:15+00:00 |
Last Successful Scan
Scanned | 2023-09-14T14:06:02+00:00 |
URL | https://maxjav.com/robots.txt |
Domain IPs | 172.66.41.44, 172.66.42.212, 2606:4700:3108::ac42:292c, 2606:4700:3108::ac42:2ad4 |
Response IP | 172.66.42.212 |
Found | Yes |
Hash | 3032c1e927840c008dcc779ecc5e6386c543c5f3512ba14564a89170e9514333 |
SimHash | 6bc9dc05eb02 |
Groups
*
Rule | Path |
---|---|
Allow | *.css |
Allow | *.js |
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Disallow | /*/comment-page-* |
Disallow | /*?replytocom=* |
Disallow | /*/trackback |
Disallow | /feed |
Disallow | /*/feed |
Disallow | /comments/feed |
Disallow | /?s=* |
Disallow | /*/?s=*%5C |
Disallow | /attachment/ |
Other Records
Field | Value |
---|---|
sitemap | https://maxjav.com/sitemap.xml |