Site.pro
  • Website Builder
    • Website Builder
    • Prices
    • Website Import
    • Online Stores
    • Plugins
    • Collaboration
    • Templates
    • Languages
    • Affiliate Program
    • Examples
    • AI Website Builder
    • For Design Studios
    • We Build for You
  • Domains
  • Email
  • Learn
    • Tutorials
    • Blog
    • FAQ
    • Growth Hacking
    • For Hostings
    • Domainity
    • For Education
  • For Resellers
    • Prices
    • White Label
    • Revenue Share
    • Panels
    • How it Works
    • Mass Import
    • Our Partners
    • Reselling Examples
    • Marketing Materials
    • Documentation
    • Free Websites
  • Website Builder
    • Website BuilderEverybody can easily create a website, landing page, or e-commerce store. Easy-to-use website builder.
    • PricesSite.pro Prices: Templates 200+, Websites, Basic Builder Functions, Online Stores, Get more website builder features.
    • Website ImportTransfer your existing website from anywhere to Site.pro website builder. Website import from different website builders.
    • Online StoresSell your goods or services anywhere on the website
    • PluginsMany functions and plugins depending on geographical preferences. Plugin description.
    • CollaborationCollaborative Website Builder, Create a website with teammates in real-time in one space, Real-Time Collaboration.
    • Templates
    • Languages
    • Affiliate Program
    • Examples
    • AI Website Builder
    • For Design Studios
    • We Build for You
  • Domains
  • Email
  • Learn
    • TutorialsVideos for Beginners. Download video tutorials for free New video tutorial.
    • BlogWebsite Builder Lifehacks: Shared hosting tips. Web Design, Marketing
    • FAQHelp center. Payment Issues. Basic Tutorial. Quick search. Have questions? Enter your question here.
    • Growth HackingBoost your sales. Strategy
    • For HostingsEducation. Generate more website builder sales
    • DomainityDomainity: Domain quantity per 1000 people
    • For EducationFree Website Builder for Online and Offline Classrooms. Collaborate with students in one space or separately.
  • For ResellersWhite Label
    • PricesStart reselling. Pay for live websites. Free Websites. Join reselling program.
    • White LabelThe most popular white label tool is ideal for reselling
    • Revenue ShareWebsite Builder: Provide free website builder and earn 50% commissions
    • PanelsOne product for all platforms. Download plugin for your panel
    • How it WorksCloud or On-Premises. Recommendations for Builder Server. Requirements for builder server (On-premises only) and published websites. Install on as many IP's and servers as you like—it's free of charge.
    • Marketing MaterialsVideo. Mockups. Website Blocks. Marketing Materials.
    • Mass Import
    • Our Partners
    • Reselling Examples
    • Documentation
    • Free Websites
  • Register

    Register

    (Buy Domain, Create email)
    (For Hosting Companies)
    By registering, you accept our Terms of Service
    Number of Customers: 1-100
    Number of Customers: 1-100
  • Log in

    Log in

    New user? Create account
    Forgot password?
  • $
  • English
Please use keywords in English only.
Account & Billing (35)Mixpanel (2)License (24)Managing Website (12)Domains: Purchasing (15)Domains: Connecting (26)Mailboxes (26)Brand: Cloud (5)Brand: On-Premises (14)Installation: Builder (10)Installation: Builder Plugin (5)Hosting/Billing panels: cPanel (9)Hosting/Billing panels: DirectAdmin (7)Hosting/Billing panels: ISPmanager (4)Hosting/Billing panels: Plesk (7)Hosting/Billing panels: Webuzo (2)Hosting/Billing panels: WHMCS (5)Website Builder: Plugins (5)Website Builder: Website creation (52)Website Builder: Pictures (11)Website Builder: Media (15)Website Builder: Additional (8)Website Builder: Text (14)Website Builder: Import (5)Website Builder: SEO (22)Website Builder: Social (13)Website Builder: Commerce (80)Website Builder: Maps (12)Website Builder: Forms (7)Website Builder: Advanced (18)Website Builder: Errors (21)Web Design Studio (3)Affiliate Program (8)Education (8)
Filter
All (510) For Hosting Companies (398) For Website Owners (380)
FAQ
›
Website Builder: SEO
How to add robots.txt?
Website Builder

How to add robots.txt?

This is an advanced feature, be careful when applying changes.

A robots.txt file is a text document that provides instructions to search engine crawlers. It indicates the specific pages on your website that they are allowed or not allowed to access.

To add your robots.txt to your website:

  1. Go to "Settings" (on the top of website builder) and select "Settings";
  2. Select "Files" tab;
  3. Mark "Enable robots.txt" box;
  4. Insert your script and click "Apply".

People also found this article using these queries:

  • How to create robots.txt?
  • Why should I use robots.txt?
  • What is a robots.txt file?
  • Does the website builder support robots.txt?
  • How to enable robots.txt?
  • Enable robots.txt tutorial
  • Instructions for search engine crawlers
  • Where can I paste my robots.txt script?
  • How to use robots.txt?
  • Crawl script robots.txt
© Site.pro 2011. Website Builder. United States.
Contact SalesTerms of Service