safgumuscubuk.com
robots.txt

Robots Exclusion Standard data for safgumuscubuk.com

Resource Scan

Scan Details

Site Domain safgumuscubuk.com
Base Domain safgumuscubuk.com
Scan Status Ok
Last Scan2024-11-14T02:36:21+00:00
Next Scan 2024-11-21T02:36:21+00:00

Last Scan

Scanned2024-11-14T02:36:21+00:00
URL https://safgumuscubuk.com/robots.txt
Domain IPs 89.163.225.9
Response IP 89.163.225.9
Found Yes
Hash 6f169934a37c810ad3c91f4edf0a65f06cb2e044ab3bf72f678d2931dc907faf
SimHash 0860508205a5

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

mediapartners-google

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

deepcrawl

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

yandex

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

msnbot

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

slurp

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

teoma

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

twiceler

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

gigabot

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

scrubby

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

robozilla

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

nutch

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

ia_archiver

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

baiduspider

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

naverbot

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

yeti

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

yahoo-mmcrawler

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

psbot

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

asterias

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

yahoo-blogs/v3.9

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

twitterbot

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

facebookexternalhit

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

rytebot/1.0.0 (+https://bot.ryte.com/)

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php