celebritydig.com
robots.txt

Robots Exclusion Standard data for celebritydig.com

Resource Scan

Scan Details

Site Domain celebritydig.com
Base Domain celebritydig.com
Scan Status Ok
Last Scan2024-11-08T13:42:24+00:00
Next Scan 2024-11-15T13:42:24+00:00

Last Scan

Scanned2024-11-08T13:42:24+00:00
URL https://celebritydig.com/robots.txt
Domain IPs 104.21.48.253, 172.67.139.224, 2606:4700:3036::ac43:8be0, 2606:4700:3037::6815:30fd
Response IP 172.67.139.224
Found Yes
Hash 6e67b42b31afd342b53d36980c5378583c27b003bf5507a4e4a4b14e04865cdd
SimHash 6a0868146ab1

Groups

*

Rule Path
Allow /
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /wp-content/themes/
Allow /wp-admin/admin-ajax.php

*

Rule Path
Disallow /usa-import-rrhldz

bingbot
googlebot
slurp

Rule Path
Disallow

*

Rule Path
Disallow /maharajganj-lok-kxnrewk

bingbot
googlebot
slurp

Rule Path
Disallow

*

Rule Path
Disallow /8ab1urcy

bingbot
googlebot
slurp

Rule Path
Disallow

*

Rule Path
Disallow /journal

bingbot
googlebot
slurp

Rule Path
Disallow

*

Rule Path
Disallow /linea-kitchens-sqpww

bingbot
googlebot
slurp

Rule Path
Disallow

Other Records

Field Value
sitemap https://celebritydig.com/usa-import-rrhldz/sitemap.xml
sitemap https://celebritydig.com/maharajganj-lok-kxnrewk/sitemap.xml
sitemap https://celebritydig.com/8ab1urcy/sitemap.xml
sitemap https://celebritydig.com/journal/sitemap.xml
sitemap https://celebritydig.com/linea-kitchens-sqpww/sitemap.xml