It depends on the setting. On public transit or a plane, it is rude in most cases to interject. The same is true of conversation at another table or seating in a restaurant or mall. But, at a social function, it's usually acceptable to ease into a conversation, especially if you approach and listen patiently. Often, in those cases, someone in the conversation will offer an opening for your input.