Is there a limit for CSV Exporter on the number of records to be included in the file?

Yes, there is a limit. We currently have a limit of 2000 records per file. If your records exceed the limit, you can utilize the Filtering feature and create multiple CSV exporter automations.