We have recently assessed the accuracy of Clinical NLP software available through either open source projects or commercial demonstration systems at processing pathology reports. This whitepaper discusses the twenty-eight deficiencies we observed in our testing of five different systems.