The history of the castle dates back to the late 18th century, when the Eichendorff family had the castle Šilheřovice built in the place of a former Renaissance fortress. It was originally a classical palace, which was later rebuilt in the pseudo-baroque style. From 1844 to 1945, the manor was owned by the Rotschild family. The castle is surrounded by a large English park with rare trees from all around the world and one of the largest 18-hole golf courses in the Czech Republic. There is also a hunting lodge in the park, which serves the public as a restaurant.

The castle building is of three wings and two storeys, with a mansard extension. At the courtyard side there is an accessory building at each wing, which is as tall as the castle building and has a richly decorated facade. The whole object is to induce the shape of the letter E, with a courtyard, which serves the guests as a parking lot.

After 1945 the building of the castle was used as a youth home, a mining apprentice training school, later as a training center and until 2008 the castle was almost unaccessible to the public. In 2008, Castle Šilheřovice changed its owner and its extensive reconstruction was initiated, and that not only of the exterior but also of the interior. Today the castle is partially accessible to the public for holding commercial events, banquets, weddings, receptions, balls, etc..