thecarousel.com
robots.txt

Robots Exclusion Standard data for thecarousel.com

Resource Scan

Scan Details

Site Domain thecarousel.com
Base Domain thecarousel.com
Scan Status Ok
Last Scan2024-10-28T04:24:03+00:00
Next Scan 2024-11-04T04:24:03+00:00

Last Scan

Scanned2024-10-28T04:24:03+00:00
URL https://thecarousel.com/robots.txt
Domain IPs 116.90.40.5
Response IP 116.90.40.5
Found Yes
Hash 39d8316d6c6afdb587ffa63723e8530bd4c8d782b90995c37665231f8b253b8a
SimHash db2355a2e2b4

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /out/
Disallow *?p=*
Disallow /wp-login.php
Disallow /wp-admin/*
Disallow /?logout&redirect_to=
Disallow *?switch=*
Disallow *?r=*
Disallow *?fb-instant=*
Disallow *?s=*
Disallow *?q=*
Disallow /search/*
Disallow /search*
Disallow /author/fb*
Disallow */item/*
Disallow /xhprof/*
Allow /wp-admin/admin-ajax.php
Allow /wp-content/*
Allow /wp-includes/js/*

facebookexternalhit

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

grapeshot

No rules defined. All paths allowed.