ParaCrawl
Open source tools to crawl, align and clean bilingual data
• Morgan McGuire • 6 min read
Available for Download ✅
⚠️ Always check the license of the data source before using the data ⚠️
- Main page: https://paracrawl.eu/
- Data Browse Link: https://paracrawl.eu/v6
- Format: .tmx or .txt
from pathlib import Path
import pandas as pd
from tmx2dataframe import tmx2dataframe
metadata, df = tmx2dataframe.read('processed_data/paracrawl_v6_en-ga.tmx')
print(len(df))
df.to_csv('processed_data/paracrawl_v6_en-ga.csv')
df.head()
1366628
| source_language | source_sentence | target_language | target_sentence | |
|---|---|---|---|---|
| 0 | en | Moncler Jackets Womens,Moncler a clothing sens... | ga | Moncler Dúin Jackets mBan Gheimhridh Zip Hoode... |
| 1 | en | Speaking at the public seminar, Director of Co... | ga | Ag labhairt dó ag an seimineár poiblí, dúirt S... |
| 2 | en | Home / 2018-B / sample happy new year message 34+ | ga | Baile / 2018-B / sampla teachtaireacht bhliain... |
| 3 | en | No. Quartz countertops are a durable and heat-... | ga | Uimh. Is iad na countertops Grianchloch buan a... |
| 4 | en | the dog becomes naughty and nervous. | ga | thiocfaidh an madra go dona agus neirbhíseach. |
df.sample(50)
| source_language | source_sentence | target_language | target_sentence | |
|---|---|---|---|---|
| 198426 | en | On 20th January, 1993, Garda Lawless was trave... | ga | Ar an 20 Eanáir 1993, bhí Garda Lawless ag tai... |
| 741199 | en | 21:8 Then, after setting out the next day, we ... | ga | 21:8 Ansin, tar éis a leagan amach an chéad lá... |
| 924975 | en | Known for launching terminal battery life high... | ga | Is eol do sheoladh saol ceallraí críochfoirt a... |
| 1310412 | en | Engineers completing reports on planning appli... | ga | Ba chóir d'innealtóirí a ullmhaíonn tuairiscí ... |
| 1241786 | en | Individual family members can react differentl... | ga | D’fhéadfadh scaradh den tsórt seo dul i bhfeid... |
| 634275 | en | The last thing one wants to find on oneself af... | ga | Is é an rud deireanach mian le duine a fháil a... |
| 157572 | en | The LENA Worxx tractor is suitable for childre... | ga | Tá an tarracóir LENA Worxx oiriúnach do leanaí... |
| 465291 | en | 2. —This Act may be cited as the Infanticide A... | ga | 2. —Féadfar an tAcht um Naíonmharú, 1949, a gh... |
| 176118 | en | The hiring of civilians with the right skills ... | ga | Earcófar sibhialtaigh a bhfuil na scileanna ce... |
| 933352 | en | (d) a demolition order made under this Part of... | ga | (d) ordú leagtha do rinneadh fén gCuid seo den... |
| 888709 | en | [GA] (2) The Garda Síochána Acts, 1923 to 1958... | ga | [EN] (2) Féadfar Achtanna n Gharda Síochána, 1... |
| 164022 | en | (b) the amount of the interest on the company'... | ga | [EN] (b) méid an úis ar bhintiúir agus iasacht... |
| 499459 | en | FÁS - Recognition of Qualifications | ga | FÁS - Aitheantas ar Cháilíochtaí |
| 752711 | en | (2) A person who fails to comply with subsecti... | ga | (2) Duine a mhainneoidh déanamh de réir fho-al... |
| 474477 | en | 19. Regulations made with the concurrence of t... | ga | 19. Féadfaidh rialacháin a déanfar le comhthoi... |
| 374173 | en | Wooden MDF Box For Wine Supplier and Factory -... | ga | Soláthróir Cás Taispeáin Humidifier Chigire Hu... |
| 1159993 | en | [GA] Application of section 14 (3) of the Agri... | ga | [EN] Alt 14 (3) den Acht Talmhaíochta (An Fora... |
| 1069310 | en | This entry was posted on July 19, 2009, 2:59 p... | ga | cuireadh i bpost ar an iontráil seo Iúil 19, 2... |
| 539502 | en | This helicopter will also be fittedwith a Bamb... | ga | Feisteofar an héileacaptar sin le buicéad Bamb... |
| 775145 | en | (2) Any person who is aggrieved by the decisio... | ga | (2) Nuair a bheidh éileamh á chinneadh ag na C... |
| 1009110 | en | rolex masterpiece automatic full gold diamond ... | ga | masterpiece Rolex Diamond uathoibríoch marcála... |
| 531551 | en | Sponsors: County Donegal Heritage Office, Done... | ga | Urraithe: Oifig Oidhreachta Chontae Dhún na nG... |
| 678310 | en | The IT Section has also supported other depart... | ga | Thug an Rannóg TF tacaíocht do ranna eile nuai... |
| 879087 | en | Online play: flash games castle defense, castl... | ga | Imirt ar líne: cluichí flash caisleán cosanta,... |
| 437555 | en | -Bands linked together by Threaded screws like... | ga | Bannaí nasctha le chéile ag scriúnna snáithith... |
| 1144512 | en | Shopping in the EU | ga | Siopadóireacht san AE |
| 733110 | en | 24 and 25 December 2013 Homily Christmas → | ga | 24 agus 25 Nollaig 2013 Aitheasc Nollag → |
| 326519 | en | Home Business and Economy Dublin Economic Monitor | ga | Baile Gnó agus Eacnamaíocht Monatóir Geilleagr... |
| 1184048 | en | First Previous (THIRD SCHEDULE. COMMITTEES TO ... | ga | An Chéad Lch. Lch. Roimhe Seo (TRIU SCEIDEAL. ... |
| 1241711 | en | Click on “On-line Hack” button below and you w... | ga | Cliceáil ar “Ar-líne Hack” cnaipe thíos agus b... |
| 1354113 | en | Now you're probably thinking That a few gaps o... | ga | Anois tá tú ag smaoineamh is dócha Nach mbeidh... |
| 804927 | en | There is no restriction on earnings or the num... | ga | Níl aon teorainn leis an tuilleamh ná leis an ... |
| 665197 | en | 3. Helps prevent hair loss and graying hair. | ga | 3. Cuidíonn sé le cosc a chur ar chaillteanas ... |
| 1185713 | en | FÁS - Supply Chain Logistics Administrator Tra... | ga | FÁS - Cúrsa Oiliúna do Riarthóir Lóistíochta S... |
| 1254702 | en | 36. Complaints about registered retail pharmac... | ga | Gearáin faoi chógaiseoirí cláraithe. 36 . |
| 705917 | en | Date Display Weekday Month Display Calendar Di... | ga | Taispeáin Dáta I rith na seachtaine Mí Taispeá... |
| 713111 | en | (d) there shall be entered into the Register s... | ga | (d) taifeadfar sa Chlár cibé sonraí eile (más ... |
| 578491 | en | The county of Meath, except the parts thereof ... | ga | Contae na Mí, ach amháin an chuid sin de atá i... |
| 1359946 | en | The French shores are washed by the North and ... | ga | Níonn na Muirir Thuaidh agus na Meánmhara, Bá ... |
| 281613 | en | Pei is a medium size dog, attentive, careful. | ga | Is madra meánmhéide é Pei, aireach, cúramach. |
| 760395 | en | Nagoya University - Higher Education abroad in... | ga | Ollscoil Nagoya - Ard-Oideachas thar lear san ... |
| 1043028 | en | Interest on and redemption of land bonds. | ga | An t-ús a bheidh ar bhannaí talmhan agus fuasc... |
| 1285606 | en | shall not be subject to the provisions of the ... | ga | ní bheidh sé nó sí faoi réir fhorálacha an Ach... |
| 446548 | en | Clothing changes a person both externally and ... | ga | Athruithe Éadaí duine seachtrach agus go hinmh... |
| 983378 | en | Thanks to the exquisite design and high qualit... | ga | Buíochas le dearadh fíorúil agus dea-chaighdeá... |
| 744588 | en | 4:9 All the things that you have learned and a... | ga | 4:9 Gach na rudaí a d'fhoghlaim tú agus glacad... |
| 384018 | en | Referendum Commission Official Languages Act 2003 | ga | An Coimisiún Reifrinn Acha na dTeangacha Oifug... |
| 1118395 | en | (If anyone here speaks Hmong, please contact us) | ga | (Má labhraíonn aon duine anseo Hmong, déan tea... |
| 99410 | en | Anabolic steroids helped me to achieve amazing... | ga | stéaróidigh Anabolic chabhraigh liom chun tort... |
| 306414 | en | Some people may feel that it is a good time to... | ga | D'fhéadfadh roinnt daoine a bhraitheann go bhf... |