d-rev.org
robots.txt

Robots Exclusion Standard data for d-rev.org

Resource Scan

Scan Details

Site Domain d-rev.org
Base Domain d-rev.org
Scan Status Ok
Last Scan2025-12-30T21:01:20+00:00
Next Scan 2026-01-29T21:01:20+00:00

Last Scan

Scanned2025-12-30T21:01:20+00:00
URL https://d-rev.org/robots.txt
Redirect https://cakhiaztn.cc/robots.txt
Redirect Domain cakhiaztn.cc
Redirect Base cakhiaztn.cc
Domain IPs 104.21.96.131, 172.67.180.252, 2606:4700:3031::6815:6083, 2606:4700:3032::ac43:b4fc
Redirect IPs 104.18.40.143, 172.64.147.113, 2606:4700:4405::ac40:9371, 2606:4700:4407::6812:288f
Response IP 104.18.40.143
Found Yes
Hash e682244efea2c8fab0c7de11a59903eed8fe09ae3d454a4b488397e82f13d320
SimHash 6b88dc00cbaa

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /*/trackback
Disallow /img/
Disallow /tag/
Disallow /feed
Disallow /*/feed
Disallow /?s=*
Disallow /?link=*
Disallow /attachment/
Disallow /author/
Disallow /page/*
Disallow /truc-tiep/page/*
Disallow /*?utm_source
Disallow /*%26utm_source

facebookexternalhit

Rule Path
Allow /

Other Records

Field Value
sitemap https://cakhiaztn.cc/sitemap.xml

Comments

  • Allow Facebook scraper