robot.txt file SEO ke liye har website ke liye ek important aspect hai, kyunki yeh search engines ko batata hai ki aapke website ke kaunse pages ya sections ko crawl nahi karna chahiye. Yeh duplicate content se bachne, crawl budget mein bachat karne aur overall indexation ko improve karne mein madad karta hai. Is article mein hum aapko batayenge ki Blogger aur WordPress platforms par robot.txt file kaise banaye jate hai.
robot.txt file kya hai?
robot.txt file ek simple text file hai jiski madad se search engine crawlers ko bataya jata hai ki aapke website ke kaunse pages ya sections ko crawl nahi karna chahiye. Yeh aapke website ke root directory mein rakha jata hai aur usse aap apne domain name ke saath “/robots.txt” add karke access kar sakte hai (jaise example.com/robots.txt).
robot.txt file kyun banaye?
Aapke website par robot.txt file banane ke kai reasons ho sakte hai:
- Duplicate content se bachne ke liye: Agar aapke paas same page ke multiple versions hai (jaise example.com, example.com/index.html) to robot.txt file ke use se search engines ko bataya jaa sakta hai ki kaunsa version crawl karna chahiye.
- Crawl budget mein bachat karne ke liye: Search engines ke paas aapke website ko crawl karne ke liye limited time aur resources hoti hai. Unhe kuch pages crawl nahi karne ke liye bata kar, aap unhe important pages par focus karne mein madad kar sakte hai.
- Indexation ko improve karne ke liye: Search engines ko kuch pages crawl nahi karne ke liye rok kar, aap apne website ke overall indexation ko improve kar sakte hai aur sirf sabse relevant pages hi search results mein include ho.
Blogger par robot.txt file kaise banaye
Blogger par robot.txt file banana relatively simple hai. Niche diye gaye steps follow kare:
- Apne Blogger account mein log in kare.
- Edit karna chahte hai blog ke “Settings” button par click kare.
- “Search preferences” tab par click kare.
- “Custom robots.txt” section tak scroll kare.
- Apne robot.txt file ke liye use karna chahte hai code enter kare.
- “Save changes” button par click kare.
WordPress par robot.txt file kaise banaye
WordPress par robot.txt file banana bhi relatively simple hai. Aapke paas do options hai:
- Plugin ka use karke: WordPress mein robot.txt file create aur manage karne ke liye kai saare plugins available hai, jaise Yoast SEO, All in One SEO Pack aur Robots Meta. In plugins ki madad se aap apne robot.txt file ko easily create aur manage kar sakte hai.
- Manually: Aap apne robot.txt file ko manually bhi create kar sakte hai. Iske liye niche diye gaye steps follow kare:
- Apne WordPress site par log in kare.
- FTP ya cPanel ke through apne site ke root directory tak jaye.
- Ek new file create kare aur usko “robots.txt” name de.
- Apne robot.txt file ke liye use karna chahte hai code enter kare.
- File ko save kare aur apne site ke root directory mein upload kare.
Robot.txt creation :- https://rb.gy/pkprw7
Conclusion
robot.txt file SEO ke liye har website ke liye ek important aspect hai. Search engines ko batakar ki aapke website ke kaunse pages ya sections ko crawl nahi karna chahiye, aap duplicate content se bach sakte hai, crawl budget mein bachat kar sakte hai aur overall indexation ko improve kar sakte hai. Is article mein humne aapko Blogger aur WordPress platforms par robot.txt file kaise banaye jate hai bataya hai. Hamesha apne site par robot.txt file check karne ke liye yaad rahe ki wo valid hai aur important pages ko block nahi kar raha hai.
