wordpress-545514-2055666.cloudwaysapps.com
robots.txt

Resource Scan

Scan Details

Site Domain wordpress-545514-2055666.cloudwaysapps.com
Base Domain cloudwaysapps.com
Scan Status Ok
Last Scan2025-08-13T17:23:24+00:00
Next Scan 2025-09-12T17:23:24+00:00

Last Scan

Scanned2025-08-13T17:23:24+00:00
URL https://wordpress-545514-2055666.cloudwaysapps.com/robots.txt
Domain IPs 207.246.125.77
Response IP 207.246.125.77
Found Yes
Hash b5df0f54985d9c654b65b23559db4399318209c9ed66115a3a07d2ce878d13a8
SimHash 6870d0824587

Groups

googlebot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 120

googlebot-image

Rule Path
Disallow

Other Records

Field Value
crawl-delay 120

googlebot-mobile

Rule Path
Disallow

Other Records

Field Value
crawl-delay 120

msnbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 120

slurp

Rule Path
Disallow

Other Records

Field Value
crawl-delay 120

teoma

Rule Path
Disallow

Other Records

Field Value
crawl-delay 120

gigabot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 120

robozilla

Rule Path
Disallow

Other Records

Field Value
crawl-delay 120

nutch

Rule Path
Disallow

Other Records

Field Value
crawl-delay 120

ia_archiver

Rule Path
Disallow

Other Records

Field Value
crawl-delay 120

baiduspider

Rule Path
Disallow

Other Records

Field Value
crawl-delay 120

naverbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 120

yeti

Rule Path
Disallow

Other Records

Field Value
crawl-delay 120

yahoo-mmcrawler

Rule Path
Disallow

Other Records

Field Value
crawl-delay 120

psbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 120

yahoo-blogs/v3.9

Rule Path
Disallow

Other Records

Field Value
crawl-delay 120

*

Rule Path
Disallow /
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /dev/
Disallow /test/
Disallow /es//comment-subscriptions/
Disallow /fr//comment-subscriptions/
Disallow /comment-subscriptions/

Other Records

Field Value
crawl-delay 120