deartiti.com
robots.txt

Robots Exclusion Standard data for deartiti.com

Resource Scan

Scan Details

Site Domain deartiti.com
Base Domain deartiti.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan4/5/2025, 2:27:16 AM
Next Scan 7/4/2025, 2:27:16 AM

Last Successful Scan

Scanned3/5/2024, 1:38:57 AM
URL https://deartiti.com/robots.txt
Domain IPs 104.21.2.158, 172.67.129.93, 2606:4700:3031::ac43:815d, 2606:4700:3033::6815:29e
Response IP 104.21.2.158
Found Yes
Hash 3a3a18e0e961cbe50a712207ceafac9594831fb8384b9e75abb9621ead6f73d7
SimHash 003cc9ea2aba

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-includes/
Allow /wp-includes/js/
Allow /wp-includes/images/
Disallow /trackback/
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /?blackhole
Disallow /*blackhole
Disallow /cgi-bin
Disallow /wp-
Disallow /?s=
Disallow *%26s%3D
Disallow /search
Disallow /author/
Disallow *?attachment_id=
Disallow */feed
Disallow */rss
Disallow */embed
Allow /wp-content/uploads/
Allow /wp-content/themes/
Allow /*/*.js
Allow /*/*.css
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif
Allow /wp-*.svg
Allow /wp-*.pdf

semrushbot

Rule Path
Disallow /

semrush

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /