Carlos Eduardo Pedreira

43 papers B 6C 1Journal 31Unranked 5
YearRankTypeTitle / Venue / Authors
2026 J jnl
A cross-entropy based direct policy search algorithm for multi-objective energy storage control.
Neural Comput. Appl.
Gabriel Matos Cardoso Leite, Carolina Gil Marcelino, Silvia Jiménez-Fernández, Elizabeth Fialho Wanner, Sancho Salcedo-Sanz, Carlos Eduardo Pedreira
2025 J jnl
Comparison between five pattern-based approaches for automated diagnostic classification of mature/peripheral B-cell neoplasms based on standardized EuroFlow flow cytometry immunophenotypic data.
Comput. Biol. Medicine
Carlos Eduardo Pedreira, Q. Lecrevisse, R. Fluxa, Javier Verde, Susana Barrena, J. Flores-Montero, P. Fernandez, D. Morf, V. H. J. van der Velden, E. Mejstrikova, J. Caetano, L. Burgos, S. Böttcher, J. J. M. van Dongen, Alberto Orfao
2024 J jnl
Efficient evolution of decision trees via fully matrix-based fitness evaluation.
Appl. Soft Comput.
Vinícius G. Costa, Sancho Salcedo-Sanz, Carlos Eduardo Pedreira
2024 J jnl
Evolving interpretable decision trees for reinforcement learning.
Artif. Intell.
Vinícius G. Costa, Jorge Pérez-Aracil, Sancho Salcedo-Sanz, Carlos Eduardo Pedreira
2024 J jnl
Optimizing therapeutic targets for breast cancer using boolean network models.
Comput. Biol. Chem.
Domenico Sgariglia, Flavia Raquel Gonçalves Carneiro, Luís Alfredo Vidal de Carvalho, Carlos Eduardo Pedreira, Nicolas Carels, Fabrício Alves Barbosa da Silva
2024 J jnl
TensorCRO: A TensorFlow-based implementation of a multi-method ensemble for optimization.
Expert Syst. J. Knowl. Eng.
Alberto Palomo-Alonso, Vinícius G. Costa, Luis M. Moreno-Saavedra, Eugenio Lorente-Ramos, Jorge Pérez-Aracil, Carlos Eduardo Pedreira, Sancho Salcedo-Sanz
2023 J jnl
Recent advances in decision trees: an updated survey.
Artif. Intell. Rev.
Vinícius G. Costa, Carlos Eduardo Pedreira
2023 J jnl
Solving an energy resource management problem with a novel multi-objective evolutionary reinforcement learning method.
Knowl. Based Syst.
Gabriel Matos Cardoso Leite, Silvia Jiménez-Fernández, Sancho Salcedo-Sanz, Carolina Gil Marcelino, Carlos Eduardo Pedreira
2022 J jnl
Feature space partition: a local-global approach for classification.
Neural Comput. Appl.
Carolina Gil Marcelino, Carlos Eduardo Pedreira
2022 J jnl
Missing Data Analysis in Regression.
Appl. Artif. Intell.
Carolina Gil Marcelino, Gabriel M. C. Leite, P. Celes, Carlos Eduardo Pedreira
2021 J jnl
Clustering Introductory Computer Science Exercises Using Topic Modeling Methods.
CoRR
Laura Oliveira Moraes, Carlos Eduardo Pedreira
2021 J jnl
Clustering Introductory Computer Science Exercises Using Topic Modeling Methods.
IEEE Trans. Learn. Technol.
Laura Oliveira Moraes, Carlos Eduardo Pedreira
2021 J jnl
Data-Driven Modeling of Breast Cancer Tumors Using Boolean Networks.
Frontiers Big Data
Domenico Sgariglia, Alessandra Jordano Conforte, Carlos Eduardo Pedreira, Luís Alfredo Vidal de Carvalho, Flavia Raquel Gonçalves Carneiro, Nicolas Carels, Fabrício Alves Barbosa da Silva
2021 B conf
Pattern Classification Applying Neighbourhood Component Analysis and Swarm Evolutionary Algorithms: A Coupled Methodology.
CEC
Gabriel M. C. Leite, Carolina Gil Marcelino, Elizabeth F. Wanner, Carlos Eduardo Pedreira, Silvia Jiménez-Fernández, Sancho Salcedo-Sanz
2020 — conf
Designing an Intelligent Tutoring System Across Multiple Classes.
CSEDM@EDM
Laura Oliveira Moraes, Carlos Eduardo Pedreira
2019 C conf
A Viability Study of Renewables and Energy Storage Systems Using Multicriteria Decision Making and an Evolutionary Approach.
EMO
Carolina Gil Marcelino, Carlos Eduardo Pedreira, Manuel Baumann, Marcel Weil, Paulo E. M. de Almeida, Elizabeth F. Wanner
2019 J jnl
A decision-tree approach for the differential diagnosis of chronic lymphoid leukemias and peripheral B-cell lymphomas.
Comput. Methods Programs Biomed.
Laura Oliveira Moraes, Carlos Eduardo Pedreira, Susana Barrena, Antonio López, Alberto Orfao
2019 — conf
CE+EPSO: a merged approach to solve SCOPF problem.
GECCO (Companion)
Carolina Gil Marcelino, Carlos Eduardo Pedreira, Elizabeth F. Wanner, Leonel M. Carvalho, Vladimiro Miranda, Armando L. da Silva
2019 J jnl
The Exact VC Dimension of the WiSARD n-Tuple Classifier.
Neural Comput.
Hugo C. C. Carneiro, Carlos Eduardo Pedreira, Felipe M. G. França, Priscila M. V. Lima
2019 J jnl
Time series classification via divergence measures between probability density functions.
Pattern Recognit. Lett.
Carlos E. Mello, André S. T. Carvalho, Adria Lyra, Carlos Eduardo Pedreira
2018 B conf
Applying C-DEEPSO to Solve Large Scale Global Optimization Problems.
CEC
Carolina Gil Marcelino, Paulo E. M. de Almeida, Carlos Eduardo Pedreira, Leonel M. Carvalho, Elizabeth F. Wanner
2017 J jnl
A universal multilingual weightless neural network tagger via quantitative linguistics.
Neural Networks
Hugo C. C. Carneiro, Carlos Eduardo Pedreira, Felipe M. G. França, Priscila M. V. Lima
2016 J jnl
Financial credit analysis via a clustering weightless neural classifier.
Neurocomputing
Douglas de O. Cardoso, Danilo S. Carvalho, Daniel S. F. Alves, Diego Fonseca Pereira de Souza, Hugo C. C. Carneiro, Carlos Eduardo Pedreira, Priscila M. V. Lima, Felipe M. G. França
2014 B conf
Credit analysis with a clustering RAM-based neural classifier.
ESANN
Douglas de O. Cardoso, Danilo S. Carvalho, Daniel S. F. Alves, Diego Fonseca Pereira de Souza, Hugo C. C. Carneiro, Carlos Eduardo Pedreira, Priscila M. V. Lima, Felipe M. G. França
2013 J jnl
Optimized bi-dimensional data projection for clustering visualization.
Inf. Sci.
Rodrigo T. Peres, Claus Aranha, Carlos Eduardo Pedreira
2010 J jnl
A new local-global approach for classification.
Neural Networks
Rodrigo T. Peres, Carlos Eduardo Pedreira
2010 J jnl
A non-linear morphometric feature selection approach for breast tumor contour from ultrasonic images.
Comput. Biol. Medicine
Wagner Coelho A. Pereira, André V. Alvarenga, Antonio Fernando C. Infantosi, Leonardo Macrini, Carlos Eduardo Pedreira
2009 J jnl
Generalized Risk Zone: Selecting Observations for Classification.
IEEE Trans. Pattern Anal. Mach. Intell.
Rodrigo T. Peres, Carlos Eduardo Pedreira
2009 J jnl
New Decision Support Tool for Treatment Intensity Choice in Childhood Acute Lymphoblastic Leukemia.
IEEE Trans. Inf. Technol. Biomed.
Carlos Eduardo Pedreira, Leonardo Macrini, Marcelo G. Land, Elaine S. Costa
2008 J jnl
A Multidimensional Classification Approach for the Automated Analysis of Flow Cytometry Data.
IEEE Trans. Biomed. Eng.
Carlos Eduardo Pedreira, Elaine S. Costa, M. Elena Arroyo, Julia Almeida, Alberto Orfao
2006 J jnl
Learning Vector Quantization with Training Data Selection.
IEEE Trans. Pattern Anal. Mach. Intell.
Carlos Eduardo Pedreira
2006 B conf
Preliminary Results on Noise Detection and Data Selection for Vector Quantization.
IJCNN
Rodrigo T. Peres, Carlos Eduardo Pedreira
2005 B conf
Input and data selection applied to heart disease diagnosis.
IJCNN
Carlos Eduardo Pedreira, Leonardo Macrini, Elaine S. Costa
2003 B conf
Mixture of Experts and Local-Global Neural Networks.
ESANN
Mayte Suárez-Fariñas, Carlos Eduardo Pedreira
2001 J jnl
An Online Learning Approach: A Methodology for Time Varying Applications.
Neural Comput. Appl.
Nitzi M. Roehl, Carlos Eduardo Pedreira
2001 J jnl
Modeling exchange rates: smooth transitions, neural networks, and linear models.
IEEE Trans. Neural Networks
Marcelo C. Medeiros, Álvaro Veiga, Carlos Eduardo Pedreira
2000 J jnl
An Architecture for Computing Zech's Logarithms in GF(2
IEEE Trans. Computers
Francisco M. de Assis, Carlos Eduardo Pedreira
2000 — conf
Combining Neural Networks and ARIMA Models for Hourly Temperature Forecast.
IJCNN (4)
Henrique S. Hippert, Carlos Eduardo Pedreira, Reinaldo Castro Souza
1999 J jnl
Multilayer Neural Networks and Function Reconstruction by Using a priori Knowledge.
Int. J. Neural Syst.
Luis Carlos C. Pedroza, Carlos Eduardo Pedreira
1995 — conf
Fuzzy ART neural network approach for incipient fault detection and isolation in rotating machines.
ICNN
Nitzi M. Roehl, Carlos Eduardo Pedreira, H. R. Teles De Azevedo
1995 — conf
Neural Networks with Missing Values Attributes.
ICNN
Carlos Eduardo Pedreira, Eduardo Parente Ribeiro
1991 J jnl
Optimal schedule for cancer chemotherapy.
Math. Program.
Carlos Eduardo Pedreira, V. B. Vila
1984 J jnl
Identification of multiplicative parameters in stochastic bilinear systems.
IEEE Trans. Syst. Man Cybern.
Carlos S. Kubrusly, Carlos Eduardo Pedreira
notebooks/redb-clickhouse-TEST.ipynb
← Index notebooks/redb-clickhouse-TEST.ipynb plaintext
Truncated preview: showing the first 16384 bytes out of 5988848 total.
{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Definitions"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [],
   "source": [
    "import clickhouse_connect"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "\n",
    "ch_TEST_client = clickhouse_connect.get_client(host='e.rationaledge.io', port=443, username='default', password='werioubTGwvf0-dsbv_', database='redb', verify=False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [],
   "source": [
    "ch_TEST_BETA_client = clickhouse_connect.get_client(host='k.rationaledge.io', port=443, username='default', password='werioubTGwvf0-dsbv_', database='default', verify=False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<bound method HttpClient.close_connections of <clickhouse_connect.driver.httpclient.HttpClient object at 0x105fd64d0>>"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ch_TEST_BETA_client.close_connections"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<clickhouse_connect.driver.summary.QuerySummary at 0x11f900810>"
      ]
     },
     "execution_count": 9,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ch_TEST_BETA_client.command(\"\"\"\n",
    "RENAME DATABASE redb TO orig_redb;\n",
    "\"\"\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## DB Creation (schema 2025-08-02)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "ch_TEST_client.command(\"\"\"\n",
    "CREATE DATABASE IF NOT EXISTS redb;\n",
    "\"\"\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Define General Tables"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "### CREATE FULL REDB DATABASE\n",
    "def create_redb_with_all_tables(client):\n",
    "    client.command(\"\"\"\n",
    "        CREATE DATABASE IF NOT EXISTS redb\n",
    "    \"\"\")\n",
    "    create_all_general_tables(client)\n",
    "    create_all_pe_tables(client)\n",
    "\n",
    "#### CREATE FULL TABLES\n",
    "def create_all_general_tables(client):\n",
    "    create_basic_properties_dbtable(client)\n",
    "    create_hashes_dbtable(client)\n",
    "    create_capa_dbtable(client)\n",
    "    create_die_dbtable(client)\n",
    "    create_extra_findings_dbtable(client)\n",
    "\n",
    "\n",
    "##################################\n",
    "#### CREATE INDIVIDUAL TABLES ####\n",
    "##################################\n",
    "\n",
    "#### GENERAL TABLES ####\n",
    "# All tables have SETTINGS index_granularity = 8192\n",
    "def create_basic_properties_dbtable(client):\n",
    "    # Create samples_metadata table\n",
    "    client.command(\"\"\"\n",
    "        CREATE TABLE IF NOT EXISTS redb_basic_properties (\n",
    "            sha256 FixedString(64), -- primary key\n",
    "            md5 FixedString(32),\n",
    "            sha1 FixedString(40),\n",
    "            filename Nullable(String),\n",
    "            sample_name String,\n",
    "            filesize UInt64,\n",
    "            file_entropy Float64,\n",
    "            filetype LowCardinality(String),\n",
    "            filetype_mime LowCardinality(String),\n",
    "            filetype_magika LowCardinality(String),\n",
    "            analysis_date DateTime64(3, 'UTC'),\n",
    "        ) ENGINE = ReplacingMergeTree(analysis_date)\n",
    "        PRIMARY KEY (sha256)\n",
    "        ORDER BY (sha256)\n",
    "    \"\"\")\n",
    "\n",
    "def create_hashes_dbtable(client):\n",
    "    # Create hashes table\n",
    "    client.command(\"\"\"\n",
    "        CREATE TABLE IF NOT EXISTS redb_hashes (\n",
    "            sha256 FixedString(64), -- primary key\n",
    "            md5 FixedString(32),\n",
    "            sha1 FixedString(40),\n",
    "            ssdeep_hash Nullable(String),\n",
    "            tlsh_hash Nullable(String),\n",
    "            authentihash Nullable(String),\n",
    "            imphash Nullable(String),\n",
    "            impfuzzy Nullable(String),\n",
    "            typerefhash Nullable(String),\n",
    "            richhash Nullable(String),\n",
    "            richpe_hash Nullable(String),\n",
    "            richpv_hash Nullable(String),\n",
    "            richpv_hash_sorted Nullable(String),\n",
    "            dhash Nullable(String),\n",
    "            analysis_date DateTime64(3, 'UTC')\n",
    "        ) ENGINE = ReplacingMergeTree(analysis_date)\n",
    "        PRIMARY KEY (sha256)\n",
    "        ORDER BY (sha256)\n",
    "    \"\"\")\n",
    "\n",
    "def create_capa_dbtable(client):\n",
    "    # Create sample_capabilities table\n",
    "    client.command(\"\"\"\n",
    "        SET enable_json_type = 1;\n",
    "    \"\"\")\n",
    "    client.command(\"\"\"\n",
    "        -- Base table for CAPA analysis results\n",
    "        CREATE TABLE IF NOT EXISTS redb_capa (\n",
    "            sha256 FixedString(64),\n",
    "            md5 FixedString(32),\n",
    "            sha1 FixedString(40),\n",
    "            analysis_date DateTime64(3, 'UTC'),\n",
    "            -- Store full JSON dumps as strings for flexibility\n",
    "            capa_dump JSON CODEC(ZSTD(3)),\n",
    "            attack_dump JSON CODEC(ZSTD(3)),\n",
    "            mbc_dump JSON CODEC(ZSTD(3))\n",
    "        ) ENGINE = ReplacingMergeTree(analysis_date)\n",
    "        ORDER BY sha256;\n",
    "    \"\"\")\n",
    "\n",
    "    client.command(\"\"\"\n",
    "        -- Normalized table for capabilities and namespaces\n",
    "        CREATE TABLE IF NOT EXISTS redb_capa_capabilities (\n",
    "            sha256 FixedString(64),\n",
    "            md5 FixedString(32),\n",
    "            sha1 FixedString(40),\n",
    "            analysis_date DateTime64(3, 'UTC'),\n",
    "            namespace LowCardinality(String),\n",
    "            capability LowCardinality(String)\n",
    "        ) ENGINE = ReplacingMergeTree(analysis_date)\n",
    "        ORDER BY (sha256, namespace, capability);\n",
    "    \"\"\")\n",
    "\n",
    "    client.command(\"\"\"\n",
    "        -- Materialized view for capability statistics\n",
    "        CREATE MATERIALIZED VIEW IF NOT EXISTS redb_capa_capabilities_stats (\n",
    "            namespace LowCardinality(String),\n",
    "            capability LowCardinality(String),\n",
    "            samples_bitmap AggregateFunction(groupBitmap, UInt64),\n",
    "            occurrence_count UInt64\n",
    "        ) ENGINE = AggregatingMergeTree()\n",
    "        ORDER BY (namespace, capability)\n",
    "        AS SELECT\n",
    "            namespace,\n",
    "            capability,\n",
    "            groupBitmapState(cityHash64(sha256)) as samples_bitmap,\n",
    "            count() as occurrence_count\n",
    "        FROM redb_capa_capabilities\n",
    "        GROUP BY namespace, capability;\n",
    "    \"\"\")\n",
    "\n",
    "    client.command(\"\"\"\n",
    "        -- Normalized table for MITRE ATT&CK mappings\n",
    "        CREATE TABLE IF NOT EXISTS redb_capa_attack (\n",
    "            sha256 FixedString(64),\n",
    "            md5 FixedString(32),\n",
    "            sha1 FixedString(40),\n",
    "            analysis_date DateTime64(3, 'UTC'),\n",
    "            tactic LowCardinality(String),\n",
    "            technique LowCardinality(String),\n",
    "            technique_id LowCardinality(String)\n",
    "        ) ENGINE = ReplacingMergeTree(analysis_date)\n",
    "        ORDER BY (sha256, tactic, technique_id);\n",
    "    \"\"\")\n",
    "\n",
    "    client.command(\"\"\"\n",
    "        -- Materialized view for ATT&CK statistics\n",
    "        CREATE MATERIALIZED VIEW IF NOT EXISTS redb_capa_attack_stats (\n",
    "            tactic LowCardinality(String),\n",
    "            technique LowCardinality(String),\n",
    "            technique_id LowCardinality(String),\n",
    "            samples_bitmap AggregateFunction(groupBitmap, UInt64),\n",
    "            occurrence_count UInt64\n",
    "        ) ENGINE = AggregatingMergeTree()\n",
    "        ORDER BY (tactic, technique_id)\n",
    "        AS SELECT\n",
    "            tactic,\n",
    "            technique,\n",
    "            technique_id,\n",
    "            groupBitmapState(cityHash64(sha256)) as samples_bitmap,\n",
    "            count() as occurrence_count\n",
    "        FROM redb_capa_attack\n",
    "        GROUP BY tactic, technique, technique_id;\n",
    "    \"\"\")\n",
    "\n",
    "    client.command(\"\"\"\n",
    "        -- Normalized table for MBC mappings\n",
    "        CREATE TABLE IF NOT EXISTS redb_capa_mbc (\n",
    "            sha256 FixedString(64),\n",
    "            md5 FixedString(32),\n",
    "            sha1 FixedString(40),\n",
    "            analysis_date DateTime64(3, 'UTC'),\n",
    "            objective LowCardinality(String),\n",
    "            behavior LowCardinality(String),\n",
    "            behavior_id LowCardinality(String)\n",
    "        ) ENGINE = ReplacingMergeTree(analysis_date)\n",
    "        ORDER BY (sha256, objective, behavior_id);\n",
    "    \"\"\")\n",
    "\n",
    "    client.command(\"\"\"\n",
    "        -- Materialized view for MBC statistics\n",
    "        CREATE MATERIALIZED VIEW IF NOT EXISTS redb_capa_mbc_stats (\n",
    "            objective LowCardinality(String),\n",
    "            behavior LowCardinality(String),\n",
    "            behavior_id LowCardinality(String),\n",
    "            samples_bitmap AggregateFunction(groupBitmap, UInt64),\n",
    "            occurrence_count UInt64\n",
    "        ) ENGINE = AggregatingMergeTree()\n",
    "        ORDER BY (objective, behavior_id)\n",
    "        AS SELECT\n",
    "            objective,\n",
    "            behavior,\n",
    "            behavior_id,\n",
    "            groupBitmapState(cityHash64(sha256)) as samples_bitmap,\n",
    "            count() as occurrence_count\n",
    "        FROM redb_capa_mbc\n",
    "        GROUP BY objective, behavior, behavior_id;\n",
    "    \"\"\")\n",
    "\n",
    "def create_die_dbtable(client):\n",
    "    # Create sample_die table\n",
    "    client.command(\"\"\"\n",
    "        SET enable_json_type = 1;\n",
    "    \"\"\")\n",
    "    client.command(\"\"\"\n",
    "        CREATE TABLE IF NOT EXISTS redb_die (\n",
    "            sha256 FixedString(64),\n",
    "            md5 FixedString(32),\n",
    "            sha1 FixedString(40),\n",
    "            die_info JSON CODEC(ZSTD(3)),\n",
    "            analysis_date DateTime64(3, 'UTC')\n",
    "        ) ENGINE = ReplacingMergeTree(analysis_date)\n",
    "        PRIMARY KEY (sha256)\n",
    "        ORDER BY (sha256)\n",
    "    \"\"\")\n",
    "\n",
    "    client.command(\"\"\"\n",
    "        CREATE MATERIALIZED VIEW redb_die_mv\n",
    "        (\n",
    "            sha256 FixedString(64),\n",
    "            md5 FixedString(32),\n",
    "            sha1 FixedString(40),\n",
    "            analysis_date DateTime64(3, 'UTC'),\n",
    "            compiler LowCardinality(Nullable(String)),\n",
    "            compiler_full Nullable(String),\n",
    "            format LowCardinality(Nullable(String)),\n",
    "            format_full Nullable(String),\n",
    "            installer LowCardinality(Nullable(String)),\n",
    "            installer_full Nullable(String),\n",
    "            joiner LowCardinality(Nullable(String)),\n",
    "            joiner_full Nullable(String),\n",
    "            language LowCardinality(Nullable(String)),\n",
    "            language_full Nullable(String),\n",
    "            library LowCardinality(Nullable(String)),\n",
    "            library_full Nullable(String),\n",
    "            linker LowCardinality(Nullable(String)),\n",
    "            linker_full Nullable(String),\n",
    "            operation_system LowCardinality(Nullable(String)),\n",
    "            operation_system_full Nullable(String),\n",
    "            packer LowCardinality(Nullable(String)),\n",
    "            packer_full Nullable(String),\n",
    "            protector LowCardinality(Nullable(String)),\n",
    "            protector_full Nullable(String),\n",
    "            sfx LowCardinality(Nullable(String)),\n",
    "            sfx_full Nullable(String),\n",
    "            sign_tool LowCardinality(Nullable(String)),\n",
    "            sign_tool_full Nullable(String),\n",
    "            stub LowCardinality(Nullable(String)),\n",
    "            stub_full Nullable(String),\n",
    "            tool LowCardinality(Nullable(String)),\n",
    "            tool_full Nullable(String),   \n",
    "            -- overlay JSON CODEC(ZSTD(3)),\n",
    "            -- resource JSON CODEC(ZSTD(3)),\n",
    "            has_overlay UInt8,\n",
    "            has_resources UInt8,\n",
    "            is_packed UInt8\n",
    "        )\n",
    "        ENGINE = ReplacingMergeTree(analysis_date)\n",
    "        ORDER BY (sha256)\n",
    "        POPULATE\n",
    "        AS SELECT\n",
    "            sha256,\n",
    "            md5,\n",
    "            sha1,\n",
    "            analysis_date,\n",
    "            nullIf(JSONExtractString(toString(die_info), 'compiler'), '') AS compiler,\n",
    "            nullIf(JSONExtractString(toString(die_info), 'compiler(full)'), '') AS compiler_full,\n",
    "            nullIf(JSONExtractString(toString(die_info), 'format'), '') AS format,\n",
    "            nullIf(JSONExtractString(toString(die_info), 'format(full)'), '') AS format_full,\n",
    "            nullIf(JSONExtractString(toString(die_info), 'installer'), '') AS installer,\n",
    "            nullIf(JSONExtractString(toString(die_info), 'installer(full)'), '') AS installer_full,\n",
    "            nullIf(JSONExtractString(toString(die_info), 'joiner'), '') AS joiner,\n",
    "            nullIf(JSONExtractString(toString(die_info), 'joiner(full)'), '') AS joiner_full,\n",
    "            nullIf(JSONExtractString(toString(die_info), 'language'), '') AS language,\n",
    "            nullIf(JSONExtractString(toString(die_info), 'language(full)'), '') AS language_full,\n",
    "            nullIf(JSONExtractString(toString(die_info), 'library'), '') AS library,\n",
    "            nullIf(JSONExtractString(toString(die_info), 'library(full)'), '') AS library_full,\n",
    "            nullIf(JSONExtractString(toString(die_info), 'linker'), '') AS linker,\n",
    "            nullIf(JSONExtractString(toString(die_info), 'linker(full)'), '') AS linker_full,\n",
    "            nullIf(JSONExtractString(toString(die_info), 'operation_system'), '') AS operation_system,\n",
    "            nullIf(JSONExtractString(toString(die_info), 'operation_system(full)'), '') AS operation_system_full,\n",
    "            nullIf(JSONExtractString(toString(die_info), 'packer'), '') AS packer,\n",
    "            nullIf(JSONExtractString(toString(die_info), 'packer(full)'), '') AS packer_full,\n",
    "            nullIf(JSONExtractString(toString(die_info), 'protector'), '') AS protector,\n",
    "            nullIf(JSONExtractString(toString(die_info), 'protector(full)'), '') AS protector_full,\n",
    "            nullIf(JSONExtractString(toString(die_info), 'sfx'), '') AS sfx,\n",
    "            nullIf(JSONExtractString(toString(die_info), 'sfx(full)'), '') AS sfx_full,\n",
    "            nullIf(JSONExtractString(toString(die_info), 'sign_tool'), '') AS sign_tool,\n",
    "            nullIf(JSONExtractString(toString(die_info), 'sign_tool(full)'), '') AS sign_tool_full,\n",
    "            nullIf(JSONExtractString(toString(die_info), 'stub'), '') AS stub,\n",
    "            nullIf(JSONExtractString(toString(die_info),