smartpassiveincome.com
robots.txt

Robots Exclusion Standard data for smartpassiveincome.com

Resource Scan

Scan Details

Site Domain smartpassiveincome.com
Base Domain smartpassiveincome.com
Scan Status Ok
Last Scan2024-10-12T07:05:34+00:00
Next Scan 2024-11-11T07:05:34+00:00

Last Scan

Scanned2024-10-12T07:05:34+00:00
URL https://smartpassiveincome.com/robots.txt
Redirect https://www.smartpassiveincome.com/robots.txt
Redirect Domain www.smartpassiveincome.com
Redirect Base smartpassiveincome.com
Domain IPs 104.20.18.5, 104.20.19.5, 2606:4700:10::6814:1205, 2606:4700:10::6814:1305
Redirect IPs 104.20.18.5, 104.20.19.5, 2606:4700:10::6814:1205, 2606:4700:10::6814:1305
Response IP 104.20.18.5
Found Yes
Hash d579035ba55107a7f06084e9c64a37119ee243dec9dd760ecf46f78da3b687be
SimHash 61051c40e7f2

Groups

*

Rule Path
Disallow *?replytocom

Other Records

Field Value
crawl-delay 5

bingbot

Rule Path
Disallow *?replytocom

Other Records

Field Value
crawl-delay 10

ahrefsbot

Rule Path
Disallow *?replytocom

Other Records

Field Value
crawl-delay 10

rogerbot

Rule Path
Disallow *?replytocom

Other Records

Field Value
crawl-delay 60

paperlibot

Rule Path
Disallow *?replytocom

Other Records

Field Value
crawl-delay 60

Other Records

Field Value
sitemap https://www.smartpassiveincome.com/sitemap_index.xml