mempelajari.com
robots.txt

Robots Exclusion Standard data for mempelajari.com

Resource Scan

Scan Details

Site Domain mempelajari.com
Base Domain mempelajari.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-04T04:55:04+00:00
Next Scan 2024-08-02T04:55:04+00:00

Last Successful Scan

Scanned2023-01-09T14:48:52+00:00
URL https://mempelajari.com/robots.txt
Domain IPs 104.21.33.122, 172.67.162.137, 2606:4700:3034::ac43:a289, 2606:4700:3036::6815:217a
Response IP 104.21.33.122
Found Yes
Hash beb1f2b4d900e20ee6ba2e6248e507339e1684bdf8ceecb988e778f068750351
SimHash 6439d94145f4

Groups

*

Rule Path
Disallow /feed/
Disallow /author/

msnbot

Rule Path
Disallow /author/
Disallow /feed/

Other Records

Field Value
crawl-delay 120

bingbot

Rule Path
Disallow /author/
Disallow /feed/

Other Records

Field Value
crawl-delay 120

googlebot

Rule Path
Disallow /author/