Semaphore 5.2.2

Semaphore 5.2.2 is a minor update to the software and an update to the Semaphore 5.2.1 release.

Installation Prerequisites

Prior to installing or upgrading to this version of Semaphore please be sure to review the Third-party software requirements (Linux) or Third-party software requirements (Windows) information as well as the general Plan your Semaphore Installation (Linux) or Plan your Semaphore Installation (Windows) information for installation server requirements.

Product Notes

This version of Semaphore consists of the following components:

Platform Independent Components

Windows Components

Linux Applications

Integrations

(*) Unchanged from previous release.

(**) Unchanged from previous release but version number updated.

Studio (5.2.2)

Issues Resolved

• 9450 - Improve performance of adding a related concept with multiple relations

FACTS (5.2.2)

Issues Resolved

• 9305 Forced preclusion issue sorted

Classification Server (5.2.2)

Issues Resolved

• 9440 - Better handling of broken embedded objects in PPTX files
• 9491 - Better extraction of text in pptx files when in xmlexport mode
• 9456 - Better language detection in some PDF files.

Semantic Enhancement Server (5.2.2)

Issues Resolved

• 9486 Reversion of SAYT ordering - terms which start with the type text will be preferred

Known Issues (Semaphore 5.2.2)

Installation of Studio (Semaphore 5.2.2)

• When installing to Windows you may get a warning about a failure to determine the version of Java in selected JAVA_HOME. Please ignore this message.
• If you do not have Java 11 installed, when you install Semaphore Studio you will be warned that Semaphore Studio requires “Java version 11 or later.” In fact it requires Java 11. Refer to Install third-party software in the Install Semaphore on Windows for details on how to install it.
• If you upgrade Java 11 to version 11.0.20 or later, Semaphore Studio will not start. You will see a message similar to the following in the Studio catalina.out file under logs: Unable to open JAR file, probably deleted: Invalid CEN header (invalid zip64 extra data field size). If you encounter this problem, you either downgrade JDK 11 to version 11.0.19 (or earlier), or upgrade your Semaphore instance to version 5.6. If neither of these is possible then the following can be used:

The problem here is that in moving from 11.0.19 to 11.0.20, the validation of zip files has been “improved” see Improved ZIP64 Extra Field Validation (JDK-8302483 (not public)).

This validation can be switched off by supplying the environment variable jdk.util.zip.disableZip64ExtraFieldValidation=true to the Studio application (and the other Semaphore services too). You can do this by running the following before starting the services (assuming a Linux installation--the windows installation should be the equivalent):

export JAVA_OPTS=-Djdk.util.zip.disableZip64ExtraFieldValidation=true

For Linux, if you are running the Semaphore processes as services then in Studio you should just need to add the following to the JAVA_OPTS:

-Djdk.util.zip.disableZip64ExtraFieldValidation=true

This is contained in /opt/semaphore/studio/bin/setenv.sh.

So, it looks something like this:

JAVA_OPTS="$JAVA_OPTS -Djdk.util.zip.disableZip64ExtraFieldValidation=true -Djuli-logback.configurationFile=$CATALINA_BASE/conf/logback-tomcat.xml"

For other Studio component services, such as “DA” (Document Analysis), “SM” (SES Manager), or “RM” (Rulebase Manager), you will need to update the file /opt/semaphore/<component name>/bin/start.sh (e.g. /opt/semaphore/da/bin/start.sh) to add the following parameter to the Java call:

-Djdk.util.zip.disableZip64ExtraFieldValidation=true \

For example:

/usr/bin/java \
  -Xms256M -Xmx2048M \
  -XX:+UseG1GC -XX:MaxGCPauseMillis=100 \
  -Xlog:gc*,gc+ref=debug,gc+heap=debug,gc+age=trace:file=logs/gc-%t.log:tags,uptime,time,level:filecount=10,filesize=50m \
  -Djava.io.tmpdir=/var/opt/semaphore/da/temp \
  -Dorg.apache.felix.http.host=127.0.0.1 \
  -Dorg.osgi.service.http.port=5081 \
  -Djdk.util.zip.disableZip64ExtraFieldValidation=true \
  -jar bin/da.jar

Classification Server (5.2.2)

• Because of changes to how text is parsed prior to analysis, some inline style changes in PDFs (e.g. emphasised or italic text) may be treated as separate sentences or paragraphs. This could affect evidence finding where that evidence is now spread over multiple zones.
• Because of tokenization issues, Hebrew, Indonesian, Malay, Pashto and Vietnamese are temporarily being removed from the supported language set.
• We have updated our file type detection algorithm. This may change the determined file type for some documents which may affect how the document is parsed. If this is an issue, then remove the “external_parser” entry in the “classify_document” workflow in the file conf/config.xml to revert to the old style.

Stand-alone Linux Publisher (5.2.2)

Note: The following applies to the standalone publisher only, not the plugin.

• During the Linux installation you may see a spurious message about setting ACL permissions for the tomcat user. Please ignore these.

Knowledge Model Management (5.2.2)

• When downloading configuration or backup files, it is possible that the default Windows zip extractor will report the downloaded file as invalid. This is, however, likely to be due to long file paths in the zip file not being handled correctly by that extractor. An alternative (such as 7-Zip) should be able to correct extract these files.

Semaphore for SharePoint 2013/2016 Integration (4.0 r54942)

The following are known issues with this version of Semaphore for SharePoint 2013/2016:

• Use of custom hierarchical relationship types for synchronization of models may result in incorrect model information in the term store (“has narrower/has broader” hierarchical relationship synchronization works correctly)
• DE2394 - Classification Server version 4.2.0 won't work when adding in CS URL. An error “Version's parameters must be greater than or equal to zero. Parameter name: revision.” is being shown.