refrens.com
robots.txt
Robots Exclusion Standard data for refrens.com
Resource Scan
Scan Details
Site Domain | refrens.com |
Base Domain | refrens.com |
Scan Status | Ok |
Last Scan | 2024-11-12T03:04:32+00:00 |
Next Scan | 2024-11-26T03:04:32+00:00 |
Last Scan
Scanned | 2024-11-12T03:04:32+00:00 |
URL | https://refrens.com/robots.txt |
Redirect | https://www.refrens.com/robots.txt |
Redirect Domain | www.refrens.com |
Redirect Base | refrens.com |
Domain IPs | 20.235.114.220 |
Redirect IPs | 13.107.246.59, 2620:1ec:bdf::59 |
Response IP | 13.107.246.59 |
Found | Yes |
Hash | 688737688da8c9f3ac78fa7e4cd0307db806b5f42c8cb8ecf3aa44f6cb486517 |
SimHash | 680453723b40 |
Groups
*
Rule | Path |
---|---|
Disallow | /verifyemail |
Disallow | /resetpassword |
Disallow | /changepassword |
Disallow | /dashboard$ |
Disallow | /profile$ |
Disallow | /wallet$ |
Disallow | /leads$ |
Disallow | /leads/ |
Disallow | /businesses$ |
Disallow | /businesses/ |
Disallow | /*/wallet |
Disallow | /*/products |
Disallow | /*/programs |
Disallow | /*/edit |
Disallow | /*/leads |
Disallow | /*/leads/ |
Disallow | /*/leads/* |
Disallow | /*/programs/new |
Disallow | /*/products/new |
Disallow | /app$ |
Disallow | /app/* |
Disallow | /wp-admin$ |
Disallow | /grow/wp-admin$ |
Disallow | /grow/wp-admin/* |
Disallow | /grow/wp-login.php |
Disallow | /*.php$ |
Disallow | /*.json$ |
Disallow | /*.json?* |
Disallow | /*?* |
Allow | /*css?* |
Allow | /*.png?* |
Allow | /*.jpg?* |
Allow | /*.jpeg?* |
Allow | /*.gif?* |
Allow | /*.svg?* |
Allow | /*.webp?* |
Allow | /*.avif?* |
Allow | /*.ico?* |
Allow | /*.ttf?* |
Allow | /*.woff?* |
Allow | /*.woff2?* |
Allow | /*.eot?* |
Allow | /*.css?* |
Allow | /*.js?* |
Allow | /*.mjs?* |
Disallow | /*.PHP$ |
Disallow | /*.JSON$ |
Disallow | /*.JSON?* |
Disallow | /*?* |
Allow | /*CSS?* |
Allow | /*.PNG?* |
Allow | /*.JPG?* |
Allow | /*.JPEG?* |
Allow | /*.GIF?* |
Allow | /*.SVG?* |
Allow | /*.WEBP?* |
Allow | /*.AVIF?* |
Allow | /*.ICO?* |
Allow | /*.TTF?* |
Allow | /*.WOFF?* |
Allow | /*.WOFF2?* |
Allow | /*.EOT?* |
Allow | /*.CSS?* |
Allow | /*.JS?* |
Allow | /*.MJS?* |