It seems like your sentence was cut off. If you're trying to say "I'd rather you not do something," you could complete your thought with what you want the other person to not do. For example:

- "Frankly speaking, I'd rather you not come."
- "Frankly speaking, I'd rather you not say anything."

If you meant to express something else, please provide more details so I can assist you better.