apieceoftravel.com
robots.txt

Robots Exclusion Standard data for apieceoftravel.com

Resource Scan

Scan Details

Site Domain apieceoftravel.com
Base Domain apieceoftravel.com
Scan Status Ok
Last Scan2024-06-16T15:36:34+00:00
Next Scan 2024-06-23T15:36:34+00:00

Last Scan

Scanned2024-06-16T15:36:34+00:00
URL https://apieceoftravel.com/robots.txt
Redirect https://www.apieceoftravel.com/robots.txt
Redirect Domain www.apieceoftravel.com
Redirect Base apieceoftravel.com
Domain IPs 207.241.197.243
Redirect IPs 104.18.37.69, 172.64.150.187, 2606:4700:4400::6812:2545, 2606:4700:4400::ac40:96bb
Response IP 104.18.37.69
Found Yes
Hash bce9a3d25b2f7301ac567767a4d16cb6725a4fcf7b6683d920c60b1099a0fb56
SimHash 623dfa62dbb3

Groups

*

Rule Path
Allow /
Disallow *?utm_medium=*
Disallow *?utm_content=*
Disallow *?utm_source=*
Disallow *?replytocom*
Disallow *?s=*
Disallow /search*
Disallow *?p=*
Disallow *?q=*
Disallow /*/feed/*
Disallow /cdn-cgi*
Disallow /wp-json
Disallow /author/*
Disallow /tag/*
Disallow *?swcfpc=*
Disallow *?attachment_id*
Disallow /.well-known/*

anthropicbot

Rule Path
Disallow /

claude

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Allow

ahrefssiteaudit

Rule Path
Allow

Other Records

Field Value
sitemap https://www.apieceoftravel.com/sitemap_index.xml