freeshipping.org
robots.txt

Robots Exclusion Standard data for freeshipping.org

Resource Scan

Scan Details

Site Domain freeshipping.org
Base Domain freeshipping.org
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-07-07T20:28:16+00:00
Next Scan 2024-10-05T20:28:16+00:00

Last Successful Scan

Scanned2022-04-21T09:16:20+00:00
URL http://freeshipping.org/robots.txt
Redirect http://www.freeshipping.org/robots.txt
Redirect Domain www.freeshipping.org
Redirect Base freeshipping.org
Response IP 174.143.77.108
Found Yes
Hash d2845bf61f6c72f61ed7fa21cde1151eed76530ada639343ae0d8ab9b0165621
SimHash 0d74dc04f211

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /refer.php
Disallow /refer.php*
Disallow /frame.php*
Disallow /referi/
Disallow /referl/
Disallow /releases/
Disallow /search/
Disallow /blog/search/
Disallow /newsletter/

ninjabot

Rule Path
Allow /

Other Records

Field Value
sitemap http://www.freeshipping.org/sitemap.xml