smutfactor.com
robots.txt

Robots Exclusion Standard data for smutfactor.com

Resource Scan

Scan Details

Site Domain smutfactor.com
Base Domain smutfactor.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-09-24T10:48:28+00:00
Next Scan 2025-10-01T10:48:28+00:00

Last Successful Scan

Scanned2025-08-24T04:57:58+00:00
URL https://smutfactor.com/robots.txt
Redirect https://lewood.com/robots.txt
Redirect Domain lewood.com
Redirect Base lewood.com
Domain IPs 199.182.184.138
Redirect IPs 199.182.184.138
Response IP 199.182.184.138
Found Yes
Hash fc29ceedcba6da66c20ddd566b574e48925b3e4d36848ae1fa0bcad238b65f4d
SimHash c05d5c90e261

Groups

*

Rule Path
Disallow /account/
Disallow /Account/
Disallow /cart/
Disallow /Cart/
Disallow /Search/

megaindex.ru
megaindex.com
pimeyes.com crawler
ahrefs.com

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10