magicalrecipesonline.com
robots.txt

Robots Exclusion Standard data for magicalrecipesonline.com

Resource Scan

Scan Details

Site Domain magicalrecipesonline.com
Base Domain magicalrecipesonline.com
Scan Status Ok
Last Scan2025-03-30T17:36:47+00:00
Next Scan 2025-04-06T17:36:47+00:00

Last Scan

Scanned2025-03-30T17:36:47+00:00
URL https://magicalrecipesonline.com/robots.txt
Domain IPs 104.26.4.125, 104.26.5.125, 172.67.68.238, 2606:4700:20::681a:47d, 2606:4700:20::681a:57d, 2606:4700:20::ac43:44ee
Response IP 104.26.4.125
Found Yes
Hash af61b082235b4db98c45a0116e77fe45e66c9545ff43b338e2a9d1c78bb453bd
SimHash 4208dc806683

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Comments

  • vestacp autogenerated robots.txt