under.me
robots.txt

Robots Exclusion Standard data for under.me

Resource Scan

Scan Details

Site Domain under.me
Base Domain under.me
Scan Status Ok
Last Scan2025-06-04T07:49:20+00:00
Next Scan 2025-06-18T07:49:20+00:00

Last Scan

Scanned2025-06-04T07:49:20+00:00
URL https://under.me/robots.txt
Redirect https://practicalservicedesign.com/robots.txt
Redirect Domain practicalservicedesign.com
Redirect Base practicalservicedesign.com
Domain IPs 104.21.12.169, 172.67.152.210, 2606:4700:3034::ac43:98d2, 2606:4700:3037::6815:ca9
Redirect IPs 104.26.0.38, 104.26.1.38, 172.67.70.39, 2606:4700:20::681a:126, 2606:4700:20::681a:26, 2606:4700:20::ac43:4627
Response IP 104.26.0.38
Found Yes
Hash 1b328412de12621994997bde94cd7d49786a4973bba80104bfe40e03e898967a
SimHash 6958d80449a2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /author/
Disallow /*/trackback
Disallow /tag/
Disallow /*/feed
Disallow /?s=*
Disallow /attachment/
Disallow /*?utm_source
Disallow /*%26utm_source

facebookexternalhit

Rule Path
Allow /

Other Records

Field Value
sitemap https://practicalservicedesign.com/sitemap.xml

Comments

  • Allow Facebook scraper