Summary/Reported Issue
When having foreign tables (that is, tables imported using foreign data wrapper) in a PostgreSQL database, the datasets page does not show the foreign tables.
This is the database showing the tables in the public schema:
Dremio only shows the local table:
Relevant Versions
Dremio 24.3.0
Other versions may also be affected
Troubleshooting Steps
If you try to query the foreign table, it works:
And after that, if you go back to the datasets page after querying the foreign table (after a little bit once the metadata has refreshed) the previously missing table is now there:
Cause
Dremio is able to get the metadata from the PostgreSQL database it connects to but it is not able to gather the metadata details for foreign wrappers. Once the table is queried, the metadata is kept in Dremio.
Steps to Resolve
As of the time of writing there is no fix for this behavior but it is being tracked internally. It is suggested to use the workaround above.