Log In Sign Up

dbl-constructions.fr
robots.txt

Robots Exclusion Standard data for dbl-constructions.fr

Resource Scan

Scan Details

Site Domain dbl-constructions.fr
Base Domain dbl-constructions.fr
Scan Status Ok
Last Scan2025-08-29T20:37:07+00:00
Next Scan 2025-09-05T20:37:07+00:00

Last Scan

Scanned2025-08-29T20:37:07+00:00
URL https://dbl-constructions.fr/robots.txt
Redirect https://www.dbl-constructions.fr/robots.txt
Redirect Domain www.dbl-constructions.fr
Redirect Base dbl-constructions.fr
Domain IPs 104.21.18.146, 172.67.182.87, 2606:4700:3031::ac43:b657, 2606:4700:3032::6815:1292
Redirect IPs 104.21.18.146, 172.67.182.87, 2606:4700:3031::ac43:b657, 2606:4700:3032::6815:1292
Response IP 104.21.18.146
Found Yes
Hash 483007863139cfdd4bf9ad675c5d365568dbd386ad6847f5fb41eb3ef60716ed
SimHash 5b6d4c00ecbb

Groups

ahrefsbot
aspiegelbot
blexbot
barkrowler
dotbot
mj12bot
mauibot
nimbostratus-bot
petalbot
semrushbot
seznambot
sogou
serpstatbot
trendiction
textbulkerbot

Rule Path
Disallow /wp-admin/

Other Records

Field Value
crawl-delay 180

gptbot
amazonbot
bytespider
ccbot
chatgpt-user
cohere-ai
facebookbot
omgilibot

Rule Path
Disallow /

*

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://www.dbl-constructions.fr/wp-sitemap.xml
sitemap https://www.dbl-constructions.fr/sitemap-news.xml
Back to top

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK
Back to top

Warnings

  • 1 invalid line.
Back to top