usedsoo.com
robots.txt

Robots Exclusion Standard data for usedsoo.com

Resource Scan

Scan Details

Site Domain usedsoo.com
Base Domain usedsoo.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-17T05:58:46+00:00
Next Scan 2024-11-16T05:58:46+00:00

Last Successful Scan

Scanned2024-08-10T08:32:51+00:00
URL https://usedsoo.com/robots.txt
Redirect https://www.usedsoo.com/robots.txt
Redirect Domain www.usedsoo.com
Redirect Base usedsoo.com
Domain IPs 74.121.245.175
Redirect IPs 74.121.245.175
Response IP 74.121.245.175
Found Yes
Hash e2fabd9e1114cbe7eb5202ebc757471f25a34fc755f4b8c10f6ae4234ec56005
SimHash 431b1da8dbc9

Groups

mediapartners-google*

Rule Path
Disallow

cityreview

Rule Path
Disallow /

oodlebot

Rule Path
Disallow /

omniexplorer_bot

Rule Path
Disallow /

browsershots

Rule Path
Disallow

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

*

Rule Path
Disallow /select-category
Disallow /place-ad
Disallow /profile/