Log In Sign Up

contentpays.info
robots.txt

Robots Exclusion Standard data for contentpays.info

Resource Scan

Scan Details

Site Domain contentpays.info
Base Domain contentpays.info
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-09T07:04:44+00:00
Next Scan 2024-11-07T07:04:44+00:00

Last Successful Scan

Scanned2024-04-12T06:52:28+00:00
URL https://contentpays.info/robots.txt
Domain IPs 104.21.92.130, 172.67.194.35, 2606:4700:3033::ac43:c223, 2606:4700:3036::6815:5c82
Response IP 172.67.194.35
Found Yes
Hash 18586f5105ff4917876f47de90692aece5a97a0a6e4d1248d666c5f5f4dfad69
SimHash e00499640b56

Groups

*

Rule Path
Disallow */page*.php$
Disallow /map*.php$
Disallow /sitemap*.php$
Back to top

Other Records

Field Value
sitemap https://contentpays.info/sitemap.xml
sitemap https://contentpays.info/news/sitemap.xml
sitemap https://contentpays.info/c1/sitemap.xml
sitemap https://contentpays.info/c2/sitemap.xml
sitemap https://contentpays.info/c3/sitemap.xml
sitemap https://contentpays.info/c4/sitemap.xml
sitemap https://contentpays.info/c5/sitemap.xml
sitemap https://contentpays.info/c6/sitemap.xml
sitemap https://contentpays.info/c7/sitemap.xml
sitemap https://contentpays.info/c8/sitemap.xml
sitemap https://contentpays.info/c9/sitemap.xml
sitemap https://contentpays.info/c10/sitemap.xml
sitemap https://contentpays.info/c11/sitemap.xml
sitemap https://contentpays.info/c12/sitemap.xml
sitemap https://contentpays.info/c13/sitemap.xml
sitemap https://contentpays.info/c14/sitemap.xml
sitemap https://contentpays.info/c15/sitemap.xml
Back to top

Warnings

  • `host` is not a known field.
Back to top