thepay.info
robots.txt

Robots Exclusion Standard data for thepay.info

Resource Scan

Scan Details

Site Domain thepay.info
Base Domain thepay.info
Scan Status Ok
Last Scan2024-11-07T20:52:46+00:00
Next Scan 2024-11-14T20:52:46+00:00

Last Scan

Scanned2024-11-07T20:52:46+00:00
URL https://www.thepay.info/robots.txt
Redirect https://www.higherincomejobs.com/robots.txt
Redirect Domain www.higherincomejobs.com
Redirect Base higherincomejobs.com
Domain IPs 3.222.82.91, 3.86.119.31
Redirect IPs 52.22.64.135, 52.55.31.186
Response IP 52.55.31.186
Found Yes
Hash 484302610864b7bc137bc31b4976dca1bf9039e5d13a29d5040f6a2b775487a2
SimHash a8004a4ac692

Groups

*

Rule Path
Disallow /api/

adsbot-google

Rule Path
Disallow /api/

mediapartners-google

Rule Path
Disallow /api/

meta-externalagent

Rule Path Comment
Disallow / Disallow everything