https://amoro.apache.org/docs/latest/formats/ Recent content in Formats on Amoro Hugo en-us https://amoro.apache.org/docs/latest/iceberg-format/ Mon, 01 Jan 0001 00:00:00 +0000 https://amoro.apache.org/docs/latest/iceberg-format/ <!-- - Licensed to the Apache Software Foundation (ASF) under one or more - contributor license agreements. See the NOTICE file distributed with - this work for additional information regarding copyright ownership. - The ASF licenses this file to You under the Apache License, Version 2.0 - (the "License"); you may not use this file except in compliance with - the License. You may obtain a copy of the License at - - http://www.apache.org/licenses/LICENSE-2.0 - - Unless required by applicable law or agreed to in writing, software - distributed under the License is distributed on an "AS IS" BASIS, - WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. - See the License for the specific language governing permissions and - limitations under the License. --> <h1 id="iceberg-format">Iceberg Format</h1> <p>Iceberg format refers to <a href="https://iceberg.apache.org">Apache Iceberg</a> table, which is an open table format for large analytical datasets designed to provide scalable, efficient, and secure data storage and query solutions. It supports data operations on multiple storage backends and provides features such as ACID transactions, multi-version control, and schema evolution, making data management and querying more flexible and convenient.</p> https://amoro.apache.org/docs/latest/mixed-hive-format/ Mon, 01 Jan 0001 00:00:00 +0000 https://amoro.apache.org/docs/latest/mixed-hive-format/ <!-- - Licensed to the Apache Software Foundation (ASF) under one or more - contributor license agreements. See the NOTICE file distributed with - this work for additional information regarding copyright ownership. - The ASF licenses this file to You under the Apache License, Version 2.0 - (the "License"); you may not use this file except in compliance with - the License. You may obtain a copy of the License at - - http://www.apache.org/licenses/LICENSE-2.0 - - Unless required by applicable law or agreed to in writing, software - distributed under the License is distributed on an "AS IS" BASIS, - WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. - See the License for the specific language governing permissions and - limitations under the License. --> <h1 id="mixed-hive-format">Mixed-Hive Format</h1> <p>Mixed-Hive format is a format that has better compatibility with Hive than Mixed-Iceberg format. Mixed-Hive format uses a Hive table as the BaseStore and an Iceberg table as the ChangeStore. Mixed-Hive format supports:</p> https://amoro.apache.org/docs/latest/mixed-iceberg-format/ Mon, 01 Jan 0001 00:00:00 +0000 https://amoro.apache.org/docs/latest/mixed-iceberg-format/ <!-- - Licensed to the Apache Software Foundation (ASF) under one or more - contributor license agreements. See the NOTICE file distributed with - this work for additional information regarding copyright ownership. - The ASF licenses this file to You under the Apache License, Version 2.0 - (the "License"); you may not use this file except in compliance with - the License. You may obtain a copy of the License at - - http://www.apache.org/licenses/LICENSE-2.0 - - Unless required by applicable law or agreed to in writing, software - distributed under the License is distributed on an "AS IS" BASIS, - WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. - See the License for the specific language governing permissions and - limitations under the License. --> <h1 id="mixed-iceberg-format">Mixed-Iceberg Format</h1> <p>Compared with Iceberg format, Mixed-Iceberg format provides more features:</p> https://amoro.apache.org/docs/latest/formats-overview/ Mon, 01 Jan 0001 00:00:00 +0000 https://amoro.apache.org/docs/latest/formats-overview/ <!-- - Licensed to the Apache Software Foundation (ASF) under one or more - contributor license agreements. See the NOTICE file distributed with - this work for additional information regarding copyright ownership. - The ASF licenses this file to You under the Apache License, Version 2.0 - (the "License"); you may not use this file except in compliance with - the License. You may obtain a copy of the License at - - http://www.apache.org/licenses/LICENSE-2.0 - - Unless required by applicable law or agreed to in writing, software - distributed under the License is distributed on an "AS IS" BASIS, - WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. - See the License for the specific language governing permissions and - limitations under the License. --> <h1 id="formats-overview">Formats Overview</h1> <p>Table format (aka. format) was first proposed by Iceberg, which can be described as follows:</p> https://amoro.apache.org/docs/latest/paimon-format/ Mon, 01 Jan 0001 00:00:00 +0000 https://amoro.apache.org/docs/latest/paimon-format/ <!-- - Licensed to the Apache Software Foundation (ASF) under one or more - contributor license agreements. See the NOTICE file distributed with - this work for additional information regarding copyright ownership. - The ASF licenses this file to You under the Apache License, Version 2.0 - (the "License"); you may not use this file except in compliance with - the License. You may obtain a copy of the License at - - http://www.apache.org/licenses/LICENSE-2.0 - - Unless required by applicable law or agreed to in writing, software - distributed under the License is distributed on an "AS IS" BASIS, - WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. - See the License for the specific language governing permissions and - limitations under the License. --> <h1 id="paimon-format">Paimon Format</h1> <p>Paimon format refers to <a href="https://paimon.apache.org/">Apache Paimon</a> table. Paimon is a streaming data lake platform with high-speed data ingestion, changelog tracking and efficient real-time analytics.</p>