Skip to content

Test Case Descriptions

Introduction

This document gives overview of the test cases. This page is partially generated using a script, more info about the script can be found in SiVa GitHub.

The structure and elements of test case is described in QA Strategy document. All the files used in the tests can be found in SiVa GitHub.

BdocValidationFailIT.java

Open file

TestCaseID: Bdoc-ValidationFail-1

TestCaseID: Bdoc-ValidationFail-2

TestCaseID: Bdoc-ValidationFail-3

TestCaseID: Bdoc-ValidationFail-4

TestCaseID: Bdoc-ValidationFail-5

TestCaseID: Bdoc-ValidationFail-6

TestCaseID: Bdoc-ValidationFail-7

TestCaseID: Bdoc-ValidationFail-8

TestCaseID: Bdoc-ValidationFail-9

TestCaseID: Bdoc-ValidationFail-10

TestCaseID: Bdoc-ValidationFail-11

TestCaseID: Bdoc-ValidationFail-12

TestCaseID: Bdoc-ValidationFail-13

TestCaseID: Bdoc-ValidationFail-14

**Attention! This test is disabled: https://github.com/open-eid/SiVa/issues/18

TestCaseID: Bdoc-ValidationFail-15

**Attention! This test is disabled: https://github.com/open-eid/SiVa/issues/18

TestCaseID: Bdoc-ValidationFail-16

TestCaseID: Bdoc-ValidationFail-17

TestCaseID: Bdoc-ValidationFail-18

TestCaseID: Bdoc-ValidationFail-19

TestCaseID: Bdoc-ValidationFail-20

TestCaseID: Bdoc-ValidationFail-21

TestCaseID: Bdoc-ValidationFail-22

TestCaseID: Bdoc-ValidationFail-23

TestCaseID: Bdoc-ValidationFail-24

TestCaseID: Bdoc-ValidationFail-25

TestCaseID: Bdoc-ValidationFail-26

TestCaseID: Bdoc-ValidationFail-27

TestCaseID: Bdoc-ValidationFail-28

TestCaseID: Bdoc-ValidationFail-29

BdocValidationPassIT.java

Open file

TestCaseID: Bdoc-ValidationPass-1

TestCaseID: Bdoc-ValidationPass-2

TestCaseID: Bdoc-ValidationPass-3

**Attention! This test is disabled: https://github.com/open-eid/SiVa/issues/20

TestCaseID: Bdoc-ValidationPass-4

TestCaseID: Bdoc-ValidationPass-5

TestCaseID: Bdoc-ValidationPass-6

TestCaseID: Bdoc-ValidationPass-7

TestCaseID: Bdoc-ValidationPass-8

TestCaseID: Bdoc-ValidationPass-9

TestCaseID: Bdoc-ValidationPass-10

TestCaseID: Bdoc-ValidationPass-11

TestCaseID: Bdoc-ValidationPass-12

TestCaseID: Bdoc-ValidationPass-13

TestCaseID: Bdoc-ValidationPass-14

TestCaseID: Bdoc-ValidationPass-15

TestCaseID: Bdoc-ValidationPass-16

TestCaseID: Bdoc-ValidationPass-17

DdocGetDataFilesIT.java

Open file

TestCaseID: Ddoc-Get-Data-Files-1

TestCaseID: Ddoc-Get-Data-Files-2

TestCaseID: Ddoc-Get-Data-Files-3

TestCaseID: Ddoc-Get-Data-Files-4

TestCaseID: Ddoc-Get-Data-Files-5

TestCaseID: Ddoc-Get-Data-Files-6

TestCaseID: Ddoc-Get-Data-Files-7

TestCaseID: Ddoc-Get-Data-Files-8

TestCaseID: Ddoc-Get-Data-Files-9

DdocValidationFailIT.java

Open file

TestCaseID: Ddoc-ValidationFail-1

TestCaseID: Ddoc-ValidationFail-2

TestCaseID: Ddoc-ValidationFail-3

TestCaseID: Ddoc-ValidationFail-4

TestCaseID: Ddoc-ValidationFail-5

TestCaseID: Ddoc-ValidationFail-6

TestCaseID: Ddoc-ValidationFail-7

TestCaseID: Ddoc-ValidationFail-8

TestCaseID: Ddoc-ValidationFail-8

TestCaseID: Ddoc-ValidationFail-9

TestCaseID: Ddoc-ValidationFail-10

TestCaseID: Ddoc-ValidationFail-11

TestCaseID: Ddoc-ValidationFail-12

TestCaseID: Ddoc-ValidationFail-13

TestCaseID: Ddoc-ValidationFail-14

TestCaseID: Ddoc-ValidationFail-15

TestCaseID: Ddoc-ValidationFail-17

DdocValidationPassIT.java

Open file

TestCaseID: Ddoc-ValidationPass-2

**Attention! This test is disabled: https://github.com/open-eid/SiVa/issues/11

TestCaseID: Ddoc-ValidationPass-3

TestCaseID: Ddoc-ValidationPass-4

TestCaseID: Ddoc-ValidationPass-5

TestCaseID: Ddoc-ValidationPass-6

TestCaseID: Ddoc-ValidationPass-7

TestCaseID: Ddoc-ValidationPass-8

TestCaseID: Ddoc-ValidationPass-9

TestCaseID: Ddoc-ValidationPass-10

TestCaseID: Ddoc-ValidationPass-11

TestCaseID: Ddoc-ValidationPass-12

TestCaseID: Ddoc-ValidationPass-13

TestCaseID: Ddoc-ValidationPass-14

TestCaseID: Ddoc-ValidationPass-15

TestCaseID: DdocHashcode-ValidationPass-1

**Attention! This test is disabled: https://github.com/open-eid/SiVa/issues/11

TestCaseID: DdocHashcode-ValidationPass-2

**Attention! This test is disabled: This tests fails in Travis. Has been executed locally

TestCaseID: DdocHashcode-ValidationPass-3

**Attention! This test is disabled: This tests fails in Travis. Has been executed locally

TestCaseID: DdocHashcode-ValidationPass-4

**Attention! This test is disabled: This tests fails in Travis. Has been executed locally

DocumentFormatIT.java

Open file

TestCaseID: DocumentFormat-1

TestCaseID: DocumentFormat-2

TestCaseID: DocumentFormat-3

TestCaseID: DocumentFormat-4

TestCaseID: DocumentFormat-5

TestCaseID: DocumentFormat-6

TestCaseID: DocumentFormat-7

TestCaseID: DocumentFormat-8

DocumentValidationIT.java

Open file

TestCaseID: Document-Validation-1

TestCaseID: Document-Validation-2

TestCaseID: Document-Validation-3

TestCaseID: Document-Validation-4

TestCaseID: Document-Validation-5

TestCaseID: Document-Validation-6

TestCaseID: Document-Validation-7

TestCaseID: Document-Validation-8

TestCaseID: Document-Validation-9

TestCaseID: Document-Validation-10

LargeFileIT.java

Open file

TestCaseID: PDF-LargeFiles-1

TestCaseID: Bdoc-LargeFiles-1

TestCaseID: Bdoc-LargeFiles-2

TestCaseID: Ddoc-LargeFiles-1

MonitoringIT.java

Open file

TestCaseID: WebApp-Monitoring-1

PdfBaselineProfileIT.java

Open file

TestCaseID: PDF-BaselineProfile-1

TestCaseID: PDF-BaselineProfile-2

TestCaseID: PDF-BaselineProfile-3

TestCaseID: PDF-BaselineProfile-4

TestCaseID: PDF-BaselineProfile-5

TestCaseID: PDF-BaselineProfile-6

TestCaseID: PDF-BaselineProfile-7

TestCaseID: PDF-BaselineProfile-8

TestCaseID: PDF-BaselineProfile-9

TestCaseID: PDF-BaselineProfile-10

TestCaseID: PDF-BaselineProfile-11

PdfSignatureCryptographicAlgorithmIT.java

Open file

TestCaseID: PDF-SigCryptoAlg-1

TestCaseID: PDF-SigCryptoAlg-2

TestCaseID: PDF-SigCryptoAlg-4

TestCaseID: PDF-SigCryptoAlg-5

TestCaseID: PDF-SigCryptoAlg-6

TestCaseID: PDF-SigCryptoAlg-7

**Attention! This test is disabled: Bug fixed in DSS version 5.1. https://ec.europa.eu/cefdigital/tracker/browse/DSS-1145

TestCaseID: PDF-SigCryptoAlg-8

TestCaseID: PDF-SigCryptoAlg-9

PdfValidationFailIT.java

Open file

TestCaseID: PDF-ValidationFail-1

TestCaseID: PDF-ValidationFail-2

TestCaseID: PDF-ValidationFail-4

TestCaseID: PDF-ValidationFail-5

**Attention! This test is disabled: https://jira.nortal.com/browse/SIVARIA-17

TestCaseID: PDF-ValidationFail-6

**Attention! This test is disabled: https://jira.nortal.com/browse/SIVARIA-17

TestCaseID: PDF-ValidationFail-7

**Attention! This test is disabled: https://jira.nortal.com/browse/SIVARIA-17

PdfValidationPassIT.java

Open file

TestCaseID: PDF-ValidationPass-1

TestCaseID: PDF-ValidationPass-2

TestCaseID: PDF-ValidationPass-4

SignaturePolicyIT.java

Open file

TestCaseID: Pdf-Signature-Policy-1

TestCaseID: Pdf-Signature-Policy-2

**Attention! This test is disabled: New test file is needed

TestCaseID: Pdf-Signature-Policy-3

TestCaseID: Pdf-Signature-Policy-4

TestCaseID: Bdoc-Signature-Policy-1

TestCaseID: Bdoc-Signature-Policy-2

TestCaseID: Bdoc-Signature-Policy-3

TestCaseID: Bdoc-Signature-Policy-4

XRoadValidationFailIT.java

Open file

TestCaseID: Xroad-ValidationFail-1

XRoadValidationPassIT.java

Open file

TestCaseID: Xroad-ValidationPass-1

TestCaseID: Xroad-ValidationPass-2

TestCaseID: Xroad-ValidationPass-3

StatisticsToGAManualIT.java

Note

All tests in this class expect manual configuration of Google Analytics before executing the tests. The test are made to prepare test data and ease the test execution, all results must be checked manually in GA! Check all the fields presence and correctness even though tests prepare data for specific cases.

TestCaseID: Xauth-Statistics-GA-1

TestCaseID: Xauth-Statistics-GA-2

TestCaseID: Xauth-Statistics-GA-3

TestCaseID: Bdoc-Statistics-GA-1

TestCaseID: Bdoc-Statistics-GA-2

TestCaseID: Xroad-Statistics-GA-1

  • TestType: Manual
  • Requirement: http://open-eid.github.io/SiVa/pdf-files/SiVa_statistics.pdf
  • Title: Xroad valid container is validated
  • Expected Result: Country code XX is sent to GA (GA shows ZZ as the XX is unknown code), Signature container type is ASiC-E (BatchSignature)
  • File: xroad-batchsignature.asice

TestCaseID: Ddoc-Statistics-GA-1

TestCaseID: Ddoc-Statistics-Log-2

StatisticsToLogsManualIT.java

Note

All tests in this class expect manual verification of responses in log! The tests are made to prepare test data and ease the test execution.

TestCaseID: Bdoc-Statistics-Log-1

TestCaseID: Bdoc-Statistics-Log-2

TestCaseID: Bdoc-Statistics-Log-3

TestCaseID: Bdoc-Statistics-Log-4

TestCaseID: Ddoc-Statistics-Log-1

TestCaseID: Ddoc-Statistics-Log-2

TestCaseID: Ddoc-Statistics-Log-3

TestCaseID: Ddoc-Statistics-Log-4

TestCaseID: Pdf-Statistics-Log-1

TestCaseID: Pdf-Statistics-Log-2

TestCaseID: Pdf-Statistics-Log-3

TestCaseID: Pdf-Statistics-Log-4

TestCaseID: Xroad-Statistics-Log-1

TestCaseID: Xroad-Statistics-Log-2

TestCaseID: Xroad-Statistics-Log-3

GetDataFileRequestIT.java

Open file

TestCaseID: Get-Data-Files-Request-1

TestCaseID: Get-Data-Files-Request-2

TestCaseID: Get-Data-Files-Request-3

TestCaseID: Get-Data-Files-Request-4

TestCaseID: Get-Data-Files-Request-5

TestCaseID: Get-Data-Files-Request-6

TestCaseID: Get-Data-Files-Request-7

TestCaseID: Get-Data-Files-Request-8

TestCaseID: Get-Data-Files-Request-9

TestCaseID: Get-Data-Files-Request-10

TestCaseID: Get-Data-Files-Request-11

TestCaseID: Get-Data-Files-Request-12

TestCaseID: Get-Data-Files-Request-13

TestCaseID: Get-Data-Files-Request-14

TestCaseID: Get-Data-Files-Request-15

ValidationReportValueVerificationIT.java

Open file

TestCaseID: Bdoc-ValidationReportVerification-1

TestCaseID: Bdoc-ValidationReportVerification-2

TestCaseID: Bdoc-ValidationReportVerification-3

TestCaseID: Bdoc-ValidationReportVerification-5

**Attention! This test is disabled: https://github.com/open-eid/SiVa/issues/24

TestCaseID: Bdoc-ValidationReportVerification-6

TestCaseID: Bdoc-ValidationReportVerification-7

TestCaseID: Bdoc-ValidationReportVerification-8

TestCaseID: Pdf-ValidationReportVerification-1

TestCaseID: Pdf-ValidationReportVerification-2

TestCaseID: Pdf-ValidationReportVerification-3

TestCaseID: Pdf-ValidationReportVerification-4

TestCaseID: Pdf-ValidationReportVerification-5

TestCaseID: Ddoc-ValidationReportVerification-1

TestCaseID: Ddoc-ValidationReportVerification-2

TestCaseID: Ddoc-ValidationReportVerification-3

**Attention! This test is disabled: https://github.com/open-eid/SiVa/issues/15

TestCaseID: Ddoc-ValidationReportVerification-4

TestCaseID: Ddoc-ValidationReportVerification-5

TestCaseID: Ddoc-ValidationReportVerification-6

**Attention! This test is disabled: https://github.com/open-eid/SiVa/issues/11

TestCaseID: Ddoc-ValidationReportVerification-7

TestCaseID: Ddoc-ValidationReportVerification-8

TestCaseID: Ddoc-ValidationReportVerification-9

TestCaseID: Xroad-ValidationReportVerification-1

TestCaseID: Xroad-ValidationReportVerification-2

TestCaseID: Xroad-ValidationReportVerification-3

TestCaseID: Xroad-ValidationReportVerification-4

ValidationRequestIT.java

Open file

TestCaseID: ValidationRequest-1

TestCaseID: ValidationRequest-2

TestCaseID: ValidationRequest-3

TestCaseID: ValidationRequest-4

TestCaseID: ValidationRequest-5

TestCaseID: ValidationRequest-6

TestCaseID: ValidationRequest-7

TestCaseID: ValidationRequest-8

TestCaseID: ValidationRequest-9

TestCaseID: Bdoc-ValidationRequest-1

TestCaseID: Bdoc-ValidationRequest-2

TestCaseID: Bdoc-ValidationRequest-3

TestCaseID: Bdoc-ValidationRequest-4

TestCaseID: Bdoc-ValidationRequest-5

TestCaseID: Bdoc-ValidationRequest-6

TestCaseID: Bdoc-ValidationRequest-7

TestCaseID: Bdoc-ValidationRequest-8

TestCaseID: Bdoc-ValidationRequest-9

TestCaseID: Bdoc-ValidationRequest-10

TestCaseID: Bdoc-ValidationRequest-11

TestCaseID: Bdoc-ValidationRequest-12

TestCaseID: Bdoc-ValidationRequest-13

TestCaseID: Pdf-ValidationRequest-1

TestCaseID: Pdf-ValidationRequest-2

TestCaseID: Pdf-ValidationRequest-3

TestCaseID: Pdf-ValidationRequest-4

TestCaseID: Pdf-ValidationRequest-5

TestCaseID: Pdf-ValidationRequest-6

TestCaseID: Pdf-ValidationRequest-7

TestCaseID: Pdf-ValidationRequest-8

TestCaseID: Ddoc-ValidationRequest-1

TestCaseID: Ddoc-ValidationRequest-2

TestCaseID: Ddoc-ValidationRequest-3

TestCaseID: Ddoc-ValidationRequest-4

TestCaseID: Ddoc-ValidationRequest-5

TestCaseID: Ddoc-ValidationRequest-6

TestCaseID: Ddoc-ValidationRequest-7

TestCaseID: Ddoc-ValidationRequest-8

TestCaseID: Xroad-ValidationRequest-1

TestCaseID: Xroad-ValidationRequest-2

TestCaseID: Xroad-ValidationRequest-3

TestCaseID: Xroad-ValidationRequest-4

TestCaseID: Xroad-ValidationRequest-5

TestCaseID: Xroad-ValidationRequest-6

SoapGetDataFileReportIT.java

Open file

TestCaseID: SoapGetDataFile-Report-1

TestCaseID: SoapGetDataFile-Report-2

TestCaseID: SoapGetDataFile-Report-3

TestCaseID: SoapGetDataFile-Report-4

SoapGetDataFileRequestIT.java

Open file

TestCaseID: Soap-Validation-Request-For-Data-Files-1

TestCaseID: Soap-Validation-Request-For-Data-Files-2

TestCaseID: Soap-Validation-Request-For-Data-Files-3

TestCaseID: Soap-Validation-Request-For-Data-Files-4

TestCaseID: Soap-Validation-Request-For-Data-Files-5

TestCaseID: Soap-Validation-Request-For-Data-Files-6

TestCaseID: Soap-Validation-Request-For-Data-Files-7

TestCaseID: Soap-Validation-Request-For-Data-Files-8

TestCaseID: Soap-Validation-Request-For-Data-Files-9

TestCaseID: Soap-Validation-Request-For-Data-Files-10

TestCaseID: Soap-Validation-Request-For-Data-Files-11

TestCaseID: Soap-Validation-Request-For-Data-Files-12

TestCaseID: Soap-Validation-Request-For-Data-Files-13

TestCaseID: Soap-Validation-Request-For-Data-Files-14

SoapValidationReportValueIT.java

Open file

TestCaseID: Bdoc-SoapValidationReportValue-1

TestCaseID: Bdoc-SoapValidationReportValue-2

TestCaseID: Bdoc-SoapValidationReportValue-3

TestCaseID: Bdoc-SoapValidationReportValue-4

TestCaseID: Bdoc-SoapValidationReportValue-5

TestCaseID: Ddoc-SoapValidationReportValue-1

**Attention! This test is disabled: https://github.com/open-eid/SiVa/issues/11

TestCaseID: Ddoc-SoapValidationReportValue-2

TestCaseID: Ddoc-SoapValidationReportValue-3

TestCaseID: Ddoc-SoapValidationReportValue-4

TestCaseID: Pdf-SoapValidationReportValue-1

TestCaseID: Pdf-SoapValidationReportValue-2

TestCaseID: Xroad-SoapValidationReportValue-1

TestCaseID: Xroad-SoapValidationReportValue-2

SoapValidationRequestIT.java

Open file

TestCaseID: Soap-ValidationRequest-1

TestCaseID: Soap-ValidationRequest-2

TestCaseID: Soap-ValidationRequest-3

TestCaseID: Soap-ValidationRequest-4

TestCaseID: Soap-ValidationRequest-5

TestCaseID: Soap-ValidationRequest-6

TestCaseID: Soap-ValidationRequest-7

TestCaseID: Soap-ValidationRequest-8

TestCaseID: Soap-ValidationRequest-9

TestCaseID: Soap-ValidationRequest-10

TestCaseID: Soap-ValidationRequest-11

TestCaseID: Soap-ValidationRequest-12

TestCaseID: Soap-ValidationRequest-13

TestCaseID: Soap-ValidationRequest-14

TestCaseID: Soap-ValidationRequest-15

TestCaseID: Soap-ValidationRequest-16

TestCaseID: Soap-BdocValidationRequest-1

TestCaseID: Soap-BdocValidationRequest-2

TestCaseID: Soap-BdocValidationRequest-3

TestCaseID: Soap-BdocValidationRequest-4

TestCaseID: Soap-BdocValidationRequest-5

TestCaseID: Soap-BdocValidationRequest-6

TestCaseID: Soap-DdocValidationRequest-7

TestCaseID: Soap-DdocValidationRequest-1

TestCaseID: Soap-DdocValidationRequest-2

TestCaseID: Soap-DdocValidationRequest-3

TestCaseID: Soap-DdocValidationRequest-4

TestCaseID: Soap-DdocValidationRequest-5

TestCaseID: Soap-DdocValidationRequest-6

TestCaseID: Soap-PdfValidationRequest-1

TestCaseID: Soap-PdfValidationRequest-2

TestCaseID: Soap-PdfValidationRequest-3

TestCaseID: Soap-PdfValidationRequest-4

TestCaseID: Soap-PdfValidationRequest-4

TestCaseID: Soap-XroadValidationRequest-1

TestCaseID: Soap-XroadValidationRequest-2

TestCaseID: Soap-XroadValidationRequest-3

TestCaseID: Soap-XroadValidationRequest-4

SoapXRoadRequestHeaderIT.java

Open file

TestCaseID: XroadSoap-RequestVerification-1

TestCaseID: XroadSoap-RequestVerification-2

TestCaseID: XroadSoap-RequestVerification-3

TestCaseID: XroadSoap-GetDataFiles-RequestVerification-1

TestCaseID: XroadSoap-GetDataFiles-RequestVerification-2

TestCaseID: XroadSoap-GetDataFiles-RequestVerification-3

Demo Application Integration Test

TestCaseID: Demo-Application-Elements-1

  • TestType: Manual
  • Requirement:
  • Title: Upload of correct file type
  • Expected Result: Its possible to upload the file by dropping in download area or by browsing a file
  • File: Šužlikud sõid ühe õuna ära.bdoc

TestCaseID: Demo-Application-Elements-2

  • TestType: Manual
  • Requirement:
  • Title: Upload of invalid file type
  • Expected Result: File is not validated, corresponding errors are returned
  • File: XML.xml

TestCaseID: Demo-Application-Elements-3

  • TestType: Manual
  • Requirement:
  • Title: Upload file larger than 10MB
  • Expected Result: File is not validated
  • File: hellopades-lta-no-ocsp.pdf

TestCaseID: Demo-Application-Elements-4

  • TestType: Manual
  • Requirement:
  • Title: Page layout
  • Expected Result: All elements are properly displayed and can be used with different window sizes
  • File: not relevant

TestCaseID: Demo-Application-Validation-1

TestCaseID: Demo-Application-Validation-1

TestCaseID: Demo-Application-Validation-2

TestCaseID: Demo-Application-Validation-3

X-Road Soap System Test

TestCaseID: Xroad-Validate-Ddoc-1

TestCaseID: Xroad-Validate-Ddoc-2

TestCaseID: Xroad-Validate-Ddoc-3

TestCaseID: Xroad-Validate-Bdoc-1

  • TestType: Automated SoapUI
  • Requirement: http://open-eid.github.io/SiVa/siva/v2/interfaces/
  • Title: Validate valid Bdoc
  • Expected Result: The document should return validation report with one valid signature
  • File: Šužlikud sõid ühe õuna ära.bdoc

TestCaseID: Xroad-Validate-Bdoc-2

TestCaseID: Xroad-Validate-Bdoc-3

TestCaseID: Xroad-Validate-Pdf-1

TestCaseID: Xroad-Validate-Pdf-2

TestCaseID: Xroad-Validate-Pdf-3

TestCaseID: Xroad-Validate-Xroad-1

TestCaseID: Xroad-Validate-Xroad-2

TestCaseID: Xroad-Validate-Xroad-3

TestCaseID: Xroad-GetDataFiles-DDOC-1

TestCaseID: Xroad-GetDataFiles-DDOC-2

TestCaseID: Xroad-GetDataFiles-DDOC-3

Configuration System Test

TestCaseID: Configuration-Webapp-TSL-1

TestCaseID: Configuration-Webapp-TSL-3

TestCaseID: Configuration-Webapp-Keystore-1

TestCaseID: Configuration-Webapp-Scheduler-1

TestCaseID: Configuration-Webapp-Xroad-1

TestCaseID: Configuration-Webapp-GA-1

TestCaseID: Configuration-Webapp-Policy-1

TestCaseID: Configuration-Webapp-Policy-2

TestCaseID: Configuration-Webapp-Monitoring-1

TestCaseID: Configuration-Webapp-Monitoring-2

TestCaseID: Configuration-Webapp-Monitoring-3

TestCaseID: Configuration-XroadService-Monitoring-1

TestCaseID: Configuration-DemoApplication-1

TestCaseID: Configuration-DemoApplication-Monitoring-1