#General User-agent: * Disallow: /underconstruction/ Disallow: /data-room/ Disallow: /*.pdf$ Disallow: /aste-giudiziarie-chiuse/ Disallow: /failure-auctions-closed/ Disallow: /calendario-aste/ Disallow: /auctions-calendar/ Disallow: /accedi/ Disallow: /login/ # Disallow: /?id_prod_it* #Spider User-agent: Yandex User-agent: YandexTurbo User-agent: YandexBot User-agent: YandexBot/3.0 User-agent: Baiduspider User-agent: Baiduspider User-agent: Baiduspider-video User-agent: Baiduspider-image User-agent: sogou spider User-agent: YoudaoBot User-agent: moget User-agent: ichiro User-agent: NaverBot User-agent: Yeti Disallow: / #Seo Tools User-agent: DotBot User-agent: DotBot/1.1 User-agent: MJ12bot User-agent: AhrefsBot User-agent: rogerbot/1.0 User-agent: YandexMetrika User-agent: YandexMetrika/2.0 User-agent: Xenu's User-agent: Xenu's Link Sleuth 1.1c User-agent: SISTRIX User-agent: AhrefsBot/5.2 User-agent: AhrefsBot User-agent: SEOkicks User-agent: SEOkicks-Robot User-agent: YisouSpider Disallow: / Sitemap: https://www.industrialdiscount.it/sitemap/