pfirst.jp
robots.txt
Robots Exclusion Standard data for pfirst.jp
Resource Scan
Scan Details
Site Domain | pfirst.jp |
Base Domain | pfirst.jp |
Scan Status | Ok |
Last Scan | 4/23/2025, 1:50:23 PM |
Next Scan | 5/23/2025, 1:50:23 PM |
Last Scan
Scanned | 4/23/2025, 1:50:23 PM |
URL | https://www.pfirst.jp/robots.txt |
Domain IPs | 104.18.42.236, 172.64.145.20 |
Response IP | 104.18.42.236 |
Found | Yes |
Hash | f7f86b9d7757c88c6bc0bad2da39b1d62296dd65932a18726197a30843b551a4 |
SimHash | e749d011cef9 |
Groups
*
Rule | Path |
---|---|
Disallow | /on/demandware.store/Sites-pfirst-Site/ja_JP/Product-ShowQuickView |
Disallow | /*prefv1 |
Disallow | /*prefv2 |
Disallow | /*prefn1 |
Disallow | /*prefn2 |
Disallow | /*.page |
Disallow | /petsearch/ |
Disallow | /*pmax%3D |
Disallow | /*pmin%3D |
Disallow | /*dwvar |
Disallow | /*a8%3D |
Disallow | /*?yclid= |
Disallow | /*%26yclid%3D |
Disallow | /*%3Fyclid%3D |
Disallow | /*%26yclid%3D |
Disallow | /*?gclid= |
Disallow | /*%26gclid%3D |
Disallow | /*%3Fgclid%3D |
Disallow | /*%26gclid%3D |
Disallow | /contactus1$ |
Disallow | /contactus1? |
Allow | /search/cats/ |
Allow | /search/dogs/ |
Allow | /searchstore/ |
Allow | /searchpartner/ |
Allow | /search/dogs/* |
Allow | /search/cats/* |
Allow | /storedetails?storeId=* |
Allow | /partnerdetails?partnerId=* |
Allow | /on/demandware.static/Sites-pfirst-Site/-/default/*/images/favicons/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.pfirst.jp/sitemap_index.xml |