scalemates.com
robots.txt

Robots Exclusion Standard data for scalemates.com

Resource Scan

Scan Details

Site Domain scalemates.com
Base Domain scalemates.com
Scan Status Ok
Last Scan2024-07-04T22:32:18+00:00
Next Scan 2024-07-18T22:32:18+00:00

Last Scan

Scanned2024-07-04T22:32:18+00:00
URL https://scalemates.com/robots.txt
Redirect https://www.scalemates.com/robots.txt
Redirect Domain www.scalemates.com
Redirect Base scalemates.com
Domain IPs 64.225.99.60
Redirect IPs 125.56.219.3, 23.32.29.104, 2600:1413:b000:1d::17d1:2e90, 2600:1413:b000:1d::17d1:2ea4
Response IP 23.32.29.104
Found Yes
Hash cc03ad7bd0bdb90a6743ba973cfb68f8792e084b891d6260b85b6481f2f95fd5
SimHash f941d40047d9

Groups

twitterbot

Rule Path
Disallow

*

Rule Path
Disallow */ajax/
Disallow /projects/img
Disallow /albums/img
Disallow /profiles/img
Disallow /products/img
Disallow /newsfeed/img
Disallow /books/img
Disallow /collections/img
Disallow /sas/
Disallow */products/affiliatelink.php

facebookexternalhit

Rule Path
Allow /products/img
Allow /books/img

twitterbot

Rule Path
Disallow