fagalicious.com
robots.txt

Robots Exclusion Standard data for fagalicious.com

Resource Scan

Scan Details

Site Domain fagalicious.com
Base Domain fagalicious.com
Scan Status Ok
Last Scan2024-04-26T10:19:44+00:00
Next Scan 2024-05-26T10:19:44+00:00

Last Scan

Scanned2024-04-26T10:19:44+00:00
URL https://fagalicious.com/robots.txt
Domain IPs 104.26.10.6, 104.26.11.6, 172.67.70.194, 2606:4700:20::681a:a06, 2606:4700:20::681a:b06, 2606:4700:20::ac43:46c2
Response IP 172.67.70.194
Found Yes
Hash bc16876b86324882d39b87edf3fe2c186169c69d1ab11f94c7ec257a8dd493b0
SimHash 689cd80de7aa

Groups

*

Rule Path
Disallow /wp-cron.php
Disallow /wp-admin/
Disallow /r/
Disallow /a/
Disallow /search_gcse/
Disallow /search_gcse/?q=*
Disallow /search/
Disallow /search/*

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10