dessein-de-dessin.com
robots.txt

Robots Exclusion Standard data for dessein-de-dessin.com

Resource Scan

Scan Details

Site Domain dessein-de-dessin.com
Base Domain dessein-de-dessin.com
Scan Status Ok
Last Scan2024-11-05T10:49:52+00:00
Next Scan 2024-12-05T10:49:52+00:00

Last Scan

Scanned2024-11-05T10:49:52+00:00
URL https://dessein-de-dessin.com/robots.txt
Redirect https://www.dessein-de-dessin.com/robots.txt
Redirect Domain www.dessein-de-dessin.com
Redirect Base dessein-de-dessin.com
Domain IPs 104.21.19.20, 172.67.184.120, 2606:4700:3033::6815:1314, 2606:4700:3035::ac43:b878
Redirect IPs 104.21.19.20, 172.67.184.120, 2606:4700:3033::6815:1314, 2606:4700:3035::ac43:b878
Response IP 172.67.184.120
Found Yes
Hash f32745787d9718c2a0c3ba1bdb9362fe14db333005900481b5aaac2885ed6a94
SimHash 097258800d04

Groups

*

Rule Path
Disallow /wp-login.php
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-includes/
Allow /wp-content/uploads/
Allow /wp-includes/js/jquery/
Allow /wp-content/plugins/*.css*
Allow /wp-content/plugins/*.js*
Allow /wp-content/plugins/*.gif*
Disallow /wp-content/plugins
Disallow /wp-content/cache
Allow /wp-content/themes/*.css*
Allow /wp-content/themes/*.js*
Disallow /wp-content/themes
Disallow /?wordfence_lh=*
Disallow /?wordfence_lh=1&hid=*
Disallow /?wordfence_lh=*&hid=*
Disallow /cgi-bin
Disallow /*?
Disallow */trackback
Disallow /*/comments
Disallow /*.php$
Disallow /*.inc$
Disallow /*.gz
Disallow /*.cgi
Disallow */feed
Disallow */rss2
Allow /css?
Allow /js?

cloudfind

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mtrobot

Rule Path
Disallow /

semantic-visions.com crawler

Rule Path
Disallow /

um-ic

Rule Path
Disallow /

um-ln

Rule Path
Disallow /

mbcrawler

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

temeliobot-keyword-scrapper

Rule Path
Disallow /

newspaper/0.2.8

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

maxpointcrawler

Rule Path
Disallow /

tineye

Rule Path
Disallow /

Comments

  • ubermetrics-technologies.com
  • Block TinEye from crawling site