GIAC GPEN Exam - Topic 5 Question 21 Discussion
You want that some of your Web pages should not be crawled. Which one of the following options will you use to accomplish the task?
C) Place the name of restricted Web pages in the robotes.txt file.
A) Use HTML NO Crawl tag in the Web page not to be crawled.
B) Place the name of restricted Web pages in the private.txt file.
Becky
9 months agoVon
9 months agoTiffiny
10 months agoSharan
10 months agoTamie
10 months agoLemuel
10 months agoKaitlyn
10 months agoJesusita
10 months agoHarrison
10 months agoJanessa
10 months agoDyan
10 months agoGeraldo
10 months ago