546436646.com
robots.txt

Robots Exclusion Standard data for 546436646.com

Resource Scan

Scan Details

Site Domain 546436646.com
Base Domain 546436646.com
Scan Status Ok
Last Scan2024-05-22T08:35:39+00:00
Next Scan 2024-06-21T08:35:39+00:00

Last Scan

Scanned2024-05-22T08:35:39+00:00
URL http://www.546436646.com/robots.txt
Domain IPs 23.52.171.123, 23.52.171.138
Response IP 23.52.171.123
Found Yes
Hash 37e0d7b9bc1cf2fbe986c33c25a6297bddd28a1a17f540c1e752b1c1ece0211e
SimHash 1c1e16c36e90

Groups

*

Rule Path
Disallow /payments/paymentProviders/

adsbot-google

Rule Path
Disallow /payments/paymentProviders/

Comments

  • Default robots.txt file which will be used for all sites that
  • do not have their own specific robots.txt file.
  • Please add robot exclusions below. e.g.
  • User-agent: Mediapartners-Google*
  • Disallow: /