Restaurant workers are advised to "patiently" suggest other options to diners who order dog.
Any restaurant found violating the ban would be black-listed, the state-run Xinhua news agency reported.
Dog - known as "fragrant meat" - is eaten by some Chinese for purported medicinal properties.
The ban, issued by the Beijing Catering Trade Association, forbids all designated Olympic restaurants from offering dog and urges other food outlets to remove the meat from menus.
"If a customer orders dog meat, restaurant staff should patiently suggest another entree," said Xiong Yumei, deputy director of the Beijing Tourism Bureau told Xinhua.