Histone deacetylases (HDACs) are enzymes that play a key role in structural modification and gene expression. The overexpression of HDAC is associated with cancer, and thus inhibiting the enzyme could be an efficient cancer therapy. To discover new HDAC inhibitors (HDACis), we proposed an improved protocol combining a hierarchical pharmacophore search, molecular docking, and molecular dynamic simulations. The test results showed that the improved screening protocol effectively reduced the false-positive rates of drug-like chemicals. Based on the protocol, we obtained 16 hit compounds as potential HDACis from the Life Chemicals database. Enzyme inhibition experiments showed that two of the hit chemical compounds had HDAC-inhibitory effects. In vitro assays showed that Z165155756 could selectively inhibit the proliferation of cancer cells and specifically promoted apoptosis and induced G1/S phase arrest in A2780 cells. It may have potential therapeutic effects in ovarian cancer and is worthy of further investigation.