We Put Chat GPT to the Test. Here’s How It Did.

By Rossion

There’s a lot of buzz about Chat GPT as a content creation tool. Is it accurate? Will it take all our jobs? Can it be dangerous or cause legal trouble? (Spoiler: yes!) We decided to test it out.

The Assignment: “Please Write 200 Words About Ahuntsic Using Canadian English”

We chose a relatively innocuous subject: the Montreal neighbourhood of Ahuntsic, where this author recently moved! We’ve edited out certain parts of the text for length, but no other changes were made.

The Result: Not too Bad, But Not All True!

Below is the text Chat GPT generated, along with our comments and feedback.

Ahuntsic: Embracing Canadian Charm in Montreal

Comment: It looks like somehow adding “using Canadian English” into our request affected the content. “Canadian” is used often – in our view, too often. In the following paragraph, I, as a human writer, certainly would not use “Canadian” twice.

Nestled in the heart of Montreal, the borough of Ahuntsic embodies the essence of Canadian charm. With its picturesque streets, lively community spirit, and rich history, Ahuntsic offers a truly authentic Canadian experience.

Named after the Algonquin people, Ahuntsic holds a deep respect for its indigenous heritage.

Comment: Information on the origins of the name is unclear, but sources appear to credit the name to a Huron youth or to a French missionary. In addition, Canadian style would generally capitalize “Indigenous.”

Ahuntsic’s allure extends beyond its historical significance. The neighborhood boasts an abundance of green spaces, allowing residents and visitors to bask in the beauty of nature. Parks like Ahuntsic Park and the Promenade Fleury offer a serene escape from the urban bustle, providing opportunities for leisurely walks, picnics, and outdoor activities.

Comment: Promenade Fleury is not a park. It’s a section of Fleury Street with restaurants, cafés, shops, and so on. Charming? Yes. Green space? Not at all.

The community of Ahuntsic is known for its strong sense of togetherness. The residents take pride in their neighborhood and actively participate in local events and initiatives. The Marché Central, a vibrant shopping destination, serves as a meeting point where locals can gather, shop, and foster a sense of community.

Comment: I won’t outright disagree that Marché Central is a meeting point that fosters community. I will, however, clarify: Marché Central is a large outdoor shopping centre, in which people generally come by car to big box stores like Costco, Rona, Dollarama, and more, shop, maybe eat, and leave. To some, it may foster community, but it is far from a clear conclusion.

Ahuntsic captures the essence of Canadian identity with its rich history, natural beauty, and close-knit community. Whether strolling along its charming streets, immersing in indigenous culture, or savoring culinary delights, a visit to Ahuntsic offers a truly Canadian experience that is sure to leave a lasting impression.

Comment: More Canada! But with a lot of American spelling. Again, totally wrong (with the exception of “immersing in indigenous culture,” which is incorrect). But questionable.

Conclusion

Chat GPT is a tool. And like any tool, it has its positives and negatives. But from our perspective, it certainly can’t replace human writers, fact-checkers, editors, or translators!

Key Takeaways

Chat GPT is not evil. But it doesn’t replace humans and can sometimes cause more work.
Always fact-check AI-created work. Otherwise, you risk costly mistakes.
Language professionals understand nuance and cultural context – unlike Chat GPT.

Looking for a trusted translation partner? Rossion works closely with your team to deliver quality localized content on time and budget. We’d love to hear more about your project. Get in touch.