English, asked by dofobishal, 4 months ago

Which of the following are requirements in a robots.txt file?
*Disallow: [URL string not to be crawled]
O Allow: [URL string to be crawled]
O Sitemap: (sitemap URL]
O "User-agent: [user-agent name]
Mark for Later

Answers

Answered by chaitanyasaini20

0

Answer:

like like lololplolllolol

Previous Question

Next Question

Similar questions

English, 2 months ago

4 added to x and the sum is divided by 2...

English, 2 months ago

Write a speech on Reading Inspiration Day...

Physics, 2 months ago

Name the possible combinations of , resistor...

Math, 4 months ago

A shop is selling a phone for $80. The shop increases the price by 10%. a) Find the new price. b) After two weeks the shop decreases the new price by 10% .Find the price of the phone after the decrease. (Please do not write anything unrelated to the topic) (Show the workout please and write sentences because this is a word problem)\ (I'm crying because no one is helping)...

English, 4 months ago

5. Fill in the blanks. (Rahuls/Rahul's) mother took us out for lunch. a. b. A_ (lion's/lions') roar is very loud. (Pooja's/Pooja) bag. c. I left my notebook in...

Math, 9 months ago

Pranita borrowed Rs 50,000 from a friend at 18% per simple interest. She lent it to another friend at the same rate but compounded annually. Find her gain after 2 years I ve got maths exam tmrw…;pls help...

French, 9 months ago

$2545554554$ as basketball!

Math, 9 months ago

AB and CD are common tangents to other at D. If AB = 8 cm, then find the length of are common tangents to circles which touch each other at D. if AB=8 cm,then find the length of CD...