Scientific measurement importer

Import scientific measurements from CSV, JCAMP, Andor SIF, PEPE SP, and PRF, then compare the results with reference data.

acq.scientific_measurement · Version 1.0.2

This importer uses explicit profiles for different scientific formats. Expand Importer options before queueing the source, then select Format profile. The profile determines the parser, relevant fields, and supported publication contracts. Values still visible from a different profile may have a different interpretation.

CSV spectrum

For spettro-ir.csv choose spectral_csv. In order, declare infrared , wavenumber, cm^-1, absorbance, absorbance and 1 in the six scientific fields. Use columns 1 and 2, one header row, and a comma or auto separator. In the file, a wavenumber of 1040 cm⁻¹ has absorbance 0.44. Check the columns and semantics in Preview, then follow the Job to the Dataset spectrum.scientific. The 1 unit expresses the dimensionless nature of absorbance.

JCAMP, Andor SIF, PEPE SP, and PRF

jcamp_dx
Read the physical declarations from the source headers. Leave optional declarations blank or enter only values you can verify. Inconsistent declarations can prevent recognition. The CSV profile requires explicit declarations.
andor_sif
Under SIF coordinate mode, choose pixel for a pixel axis or calibrated if the file retains supported calibration coefficients. For calibrated coordinates, declare the corresponding physical quantity and unit. For an unknown signal unit, fill all three overrides only if you know its unit, quantity, and representation. Check dimensions, frames, and axes. A 1D trace can be offered as spectrum.scientific, and an image or stack as measurement.numeric_array.
perkinelmer_sp
The supported PEPE subset has constant spacing and float64 values. Read the origin, step, direction, and source units. For example, cm⁻¹ and absorbance require the appropriate source labels and encodings. An unsupported label prevents import.
perkinelmer_prf
The parser looks for PRF structures within a CFB container. Declare the time unit s, min, or h and the signal unit and quantity based on provenance. This declaration preserves the original numeric values. Check the time series and the retained RAW format.

Compare binary Datasets

  • Synthetic SIF 65567. The trace has 32 pixels and the first values are 10, 10.5, and 11 counts. In the row, set Proposed contract to spectrum.scientific. For the pila.sif stack, choose measurement.numeric_array. If the proposal remains ambiguous, Import may respond invalid dataset contract. The published stack has 32 × 24 × 3 elements, with frames indexed 0 to 2. The three values at (x=1, y=1) are 10, 110, and 210 counts. The original timestamps declare no unit. With calibrated and wavelength in nm, the training polynomial is 400 + 2.5 × pixel. The first pixel is at 402.5 nm. These are synthetic files from the single-ROI 65567 subset.
  • To view the first frame of pila.sif , open Array plane, choose signal, set Starts to 0 0 0 and Counts to 32 24 1, then click Read plane. The map shows the counts of the detector plane.
  • Synthetic PEPE SP. pepe-didattico.sp contains five coordinates from 1080 to 1000 cm⁻¹ in descending order. The step is −20 cm⁻¹ and the central point has absorbance 0.44. After Import, check in Canonical table the descending order from 1080 to 1000 cm⁻¹ and the value 0.44 at 1040 cm⁻¹.
  • Synthetic PRF CFBv3. For profilo-cfb3.prf assign timeseries.table, min, V and voltage. With missing declarations a Preview may still appear, but publication requires all three. The Dataset contains the point (0.50 min, 0.75 V). Check that the axis runs from 0 to 1 and that minutes are declared. The test covers the synthetic container; compatibility with a PRF from a real instrument has yet to be verified.

Exercise files

Sources, licenses, and SHA-256

Screenshots

Open a screenshot to view it at full size.

spettro-ir.csv added in Acquisition with Dataset ID misura_ir. The row shows the import settings.
spettro-ir.csv added in Acquisition with Dataset ID misura_ir. The row shows the import settings.
Pending Preview of spettro-ir.csv in Scientific measurement. The file variables and values are shown before import.
Pending Preview of spettro-ir.csv in Scientific measurement. The file variables and values are shown before import.
After Import, the browser shows Active Dataset: misura_ir. The Metadata tab describes the recorded result.
After Import, the browser shows Active Dataset: misura_ir. The Metadata tab describes the recorded result.
Canonical table of the HDF5 Dataset misura_ir. At 1040 cm⁻¹ the absorbance is 0.44.
Canonical table of the HDF5 Dataset misura_ir. At 1040 cm⁻¹ the absorbance is 0.44.
Canonical table of the one-dimensional SIF with detector coordinates. The axis is in pixels.
Canonical table of the one-dimensional SIF with detector coordinates. The axis is in pixels.
Pending Preview of pila.sif. The summary shows the dimensions before import.
Pending Preview of pila.sif. The summary shows the dimensions before import.
Array plane of the sif_pila Dataset. Starts 0 0 0 and Counts 32 24 1 show the first frame after Read plane.
Array plane of the sif_pila Dataset. Starts 0 0 0 and Counts 32 24 1 show the first frame after Read plane.
Canonical table of the synthetic PEPE SP. The table keeps the five points from 1080 to 1000 cm⁻¹ in descending order.
Canonical table of the synthetic PEPE SP. The table keeps the five points from 1080 to 1000 cm⁻¹ in descending order.
Canonical table of the synthetic PRF after declaring the axis in minutes and the signal in volts.
Canonical table of the synthetic PRF after declaring the axis in minutes and the signal in volts.

Controls and settings

Scrollbar

Use the horizontal or vertical scrollbar to reach fields, entries, or text outside the visible area.

Format profile

Set the parser for the file and check the contract proposal. The five profiles and their inputs are described in the previous section.

Default value in the basic configuration spectral_csv.

  • spectral_csv · Set the parser for the file and check the contract proposal. The five profiles and their inputs are described in the previous section.
  • jcamp_dx · Set the parser for the file and check the contract proposal. The five profiles and their inputs are described in the previous section.
  • andor_sif · Set the parser for the file and check the contract proposal. The five profiles and their inputs are described in the previous section.
  • perkinelmer_sp · Set the parser for the file and check the contract proposal. The five profiles and their inputs are described in the previous section.
  • perkinelmer_prf · Set the parser for the file and check the contract proposal. The five profiles and their inputs are described in the previous section.

Scientific identity

Proposed scientific identity. Check the Dataset ID in the row again and choose an ID that is free in the Session.

Default value in the basic configuration measurement.

Display name

Give the spectrum or measurement a readable title. Check the name shown in the Dataset.

Default value in the basic configuration Scientific measurement.

Spectrum kind: required CSV / JCAMP source consistency check

Declares the physical family of the spectrum. Use the type that matches the measurement, for example infrared for IR absorbance.

The field is initially blank.

X quantity: required CSV / JCAMP source consistency check

Declares the quantity on the x-axis. wavenumber indicates wavenumber and wavelength wavelength. The two quantities require consistent units.

The field is initially blank.

X unit: required CSV / JCAMP source consistency check

Indicates the x-axis unit, for example cm^-1 for wavenumber or nm for a wavelength. The declaration describes the coordinates supplied.

The field is initially blank.

Y quantity: required CSV / JCAMP source consistency check

Declares the quantity on the y-axis, for example absorbance.

The field is initially blank.

Y representation: required CSV / JCAMP source consistency check

Indicates the numeric representation of the y-axis, for example absorbance. Choose the actual representation, because quantity, scale, and unit all affect interpretation.

The field is initially blank.

Y unit: required CSV / JCAMP source consistency check

Indicates the y-axis unit. For absorbance use 1. For a scientific CSV this field is required.

The field is initially blank.

CSV X column name or 1-based index

Choose the X column by source name or by 1-based position. Check the order and units after import.

Default value in the basic configuration 1.

CSV Y column name or 1-based index

Choose the y-value column by source name or by 1-based position.

Default value in the basic configuration 2.

CSV delimiter: auto / comma / semicolon / tab

Choose the separator actually used in the source. auto estimates it from a sample. comma uses comma, semicolon semicolon, tab tab, and whitespace whitespace where available. Check that Preview returns the expected number of columns.

Default value in the basic configuration auto.

CSV has column header

Select the checkbox if the CSV contains column names. For a CSV without a header, choose the columns by index.

Default value in the basic configuration 1.

SIF coordinate mode

Use pixel for detector positions or calibrated with four supported source coefficients and an explicit physical quantity and unit.

Default value in the basic configuration pixel.

  • pixel · Use pixel for detector positions or calibrated with four supported source coefficients and an explicit physical quantity and unit.
  • calibrated · Use pixel for detector positions or calibrated with four supported source coefficients and an explicit physical quantity and unit.

Explicit SIF physical calibration source unit

Physical unit already confirmed for SIF calibration, for example nm. The parser applies the calibration to pixels according to the source coefficients.

The field is initially blank.

Explicit SIF physical calibration quantity

Physical quantity associated with the SIF calibration, for example wavelength when the polynomial returns wavelengths.

The field is initially blank.

Unknown SIF signal source unit

Fill in only if the SIF source does not identify the signal unit and you have the documented unit. A declaration incompatible with an explicit signal is rejected.

The field is initially blank.

Unknown SIF signal quantity

Assigns a documented quantity to an otherwise unknown SIF signal. Fill in all three fields together with unit and representation.

The field is initially blank.

Unknown SIF signal representation

Describes the representation of a SIF signal with unknown semantics. Fill in together with quantity and unit.

The field is initially blank.

Reviewed PRF numeric time unit s/min/h; no conversion

PRF time unit taken from the source: s, min or h. The time values remain unchanged.

The field is initially blank.

Reviewed PRF signal source unit; no inferred RMS unit

PRF signal unit from a verifiable source. The parser does not derive an RMS scale or any other unit on its own.

The field is initially blank.

Reviewed PRF signal source quantity

Declares the quantity recorded by the PRF signal. All three fields are required for publication.

The field is initially blank.

Scrollbar

Use the horizontal or vertical scrollbar to reach fields, entries, or text outside the visible area.